-- Logs begin at Thu 2021-04-15 19:08:45 UTC, end at Thu 2021-04-15 20:16:42 UTC. -- Apr 15 19:43:09.322284 dv-cinder-786384-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 15 19:43:09.329856 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 15 19:43:09.332379 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: *** Starting uWSGI 2.0.15-debian (64bit) on [Thu Apr 15 19:43:09 2021] *** Apr 15 19:43:09.332379 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Apr 15 19:43:09.332379 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Apr 15 19:43:09.332379 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: nodename: dv-cinder-786384-2-iscsi Apr 15 19:43:09.332379 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: machine: x86_64 Apr 15 19:43:09.332379 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: clock source: unix Apr 15 19:43:09.332379 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: pcre jit disabled Apr 15 19:43:09.332379 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: detected number of CPU cores: 4 Apr 15 19:43:09.332379 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: current working directory: / Apr 15 19:43:09.332379 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: detected binary path: /usr/bin/uwsgi-core Apr 15 19:43:09.332379 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: dropping root privileges as early as possible Apr 15 19:43:09.332379 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: your processes number limit is 47843 Apr 15 19:43:09.332379 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: your memory page size is 4096 bytes Apr 15 19:43:09.333464 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: detected max file descriptor number: 2048 Apr 15 19:43:09.333464 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: lock engine: pthread robust mutexes Apr 15 19:43:09.333464 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: thunder lock: enabled Apr 15 19:43:09.333464 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 15 19:43:09.333464 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: dropping root privileges after socket binding Apr 15 19:43:09.333464 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: Python version: 3.6.9 (default, Jan 26 2021, 15:33:00) [GCC 8.4.0] Apr 15 19:43:09.378089 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: Python main interpreter initialized at 0x560aabbfe9c0 Apr 15 19:43:09.378089 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: dropping root privileges after plugin initialization Apr 15 19:43:09.378089 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: python threads support enabled Apr 15 19:43:09.378089 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: your server socket listen backlog is limited to 100 connections Apr 15 19:43:09.378089 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: your mercy for graceful operations on workers is 90 seconds Apr 15 19:43:09.378538 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: mapped 402621 bytes (393 KB) for 2 cores Apr 15 19:43:09.378538 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: *** Operational MODE: preforking *** Apr 15 19:43:09.378724 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: dropping root privileges after application loading Apr 15 19:43:09.378724 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: *** uWSGI is running in multiple interpreter mode *** Apr 15 19:43:09.378724 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: spawned uWSGI master process (pid: 84735) Apr 15 19:43:09.378868 dv-cinder-786384-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 15 19:43:09.379100 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: spawned uWSGI worker 1 (pid: 84736, cores: 1) Apr 15 19:43:09.380490 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: spawned uWSGI worker 2 (pid: 84737, cores: 1) Apr 15 19:43:09.380490 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 15 19:43:14.353677 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 15 19:43:14.354227 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 15 19:43:14.355566 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 15 19:43:14.356000 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 15 19:43:14.356289 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 15 19:43:14.356746 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.357109 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.357468 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.357822 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.358194 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.358543 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 15 19:43:14.358660 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.358849 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 15 19:43:14.358967 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.359217 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.359612 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.359904 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.360256 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.360456 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 15 19:43:14.360627 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-786384-2-iscsi {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.360892 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 15 19:43:14.361002 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.361186 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 15 19:43:14.361285 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.361622 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.361726 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.362505 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.362614 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.362850 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.362958 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.363205 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.363337 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.363567 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.363674 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.363935 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.364186 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.364299 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.364531 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.364642 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.364873 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.364982 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.365220 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.365319 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.365568 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.365677 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.365922 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.366030 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-786384-2-iscsi {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.366267 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.366377 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.366607 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.366711 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.366945 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.367052 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.367329 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.367448 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.367677 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.367776 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.368039 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.368143 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-786384-2-iscsi {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.368383 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.368493 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.368729 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.368993 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.369112 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.369343 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.369536 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.369686 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.369884 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.370035 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.370230 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.370417 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.370593 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.370771 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.370955 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.371121 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.371308 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.371514 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.371696 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.371863 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.372058 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.372231 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.372419 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.372583 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.372780 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.372950 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-786384-2-iscsi {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.373118 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.373302 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.373461 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.373652 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.373812 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.374003 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.374169 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.374487 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.374588 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.374823 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.374930 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.375106 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.375211 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.375475 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.375579 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.375835 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.375946 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.376190 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.376291 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.376549 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.376650 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.376832 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.376943 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.377114 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.377214 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.378089 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.378205 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.378453 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.378554 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.378796 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.378901 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.379133 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.379238 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.379507 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.379615 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.379845 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.379956 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.380177 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.380283 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.380456 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.380556 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.380807 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.380914 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.381146 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.381246 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.381505 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.381607 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.381860 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.381960 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.382140 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.382240 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.382426 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.382525 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.382793 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.382893 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.383163 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.383318 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.383546 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.383666 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.383894 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.383999 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.384241 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.384342 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.384590 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.384701 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.384927 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.385027 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.385265 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.385365 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.385613 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.385723 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.385947 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.386045 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.386290 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.386389 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.386631 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.386740 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.386989 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.387088 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.387367 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.387470 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.387711 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.387822 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.387993 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.388161 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.388328 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.388433 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.388668 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.388775 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.389026 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.389132 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.389368 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.389473 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.389712 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.389812 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.390053 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.390152 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.390390 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.390496 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.390732 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.390860 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.391073 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.391173 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.391436 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.391541 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.391773 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.391873 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.392120 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.392234 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.392456 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.392582 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.392743 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.392858 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.393110 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.393218 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.393443 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.393572 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.393798 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.393900 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.394144 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.394244 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.394478 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.394586 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.394816 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.394916 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.395148 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.395253 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.395523 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.395620 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.395863 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.395973 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.396196 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.396295 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.396537 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.396657 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.396878 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.396977 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.397209 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.397308 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.397547 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.397654 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.397893 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.397994 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.398224 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.398327 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.398564 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.398664 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.398919 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.399018 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.399245 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.399368 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.399610 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.399711 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.399958 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.400056 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.400290 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.400395 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.400629 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.400734 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.400970 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.401133 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.401302 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.401453 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.401615 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.401778 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.401939 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.402089 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.402250 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.402407 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.402558 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.402707 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.402856 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.403014 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.403164 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.403376 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.403531 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.403631 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.403844 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.403945 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.404185 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.404293 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.404523 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.404622 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.404877 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.404981 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.405222 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.405329 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.405563 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.405675 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.405906 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.406017 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.406244 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.406345 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.406586 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.406685 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.406928 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.407027 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.407301 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.407405 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.407628 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.407727 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.407969 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.408067 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.408333 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.408440 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.408692 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.408798 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.409033 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.409132 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.409373 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.409473 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.409730 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:43:14.409828 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.410074 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.410182 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.410446 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.410545 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.410796 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.410895 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.411145 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.411254 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.411521 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.411621 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.411866 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.411964 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.412217 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.412330 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.412561 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.412660 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.412908 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.413007 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.413254 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.413363 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.413596 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.413772 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.413991 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.414141 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.414289 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.414390 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.414654 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.414760 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.414991 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.415099 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.415375 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.415489 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.415726 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.415832 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.416069 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.416180 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.416414 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.416514 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.416753 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.416853 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.417094 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.417200 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.417438 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.417537 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.417789 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.417895 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.418138 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.418243 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.418486 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.418590 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.418827 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.418926 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.419168 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.419290 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.419531 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.419649 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.419875 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.419982 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.420213 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.420312 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.420572 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.420710 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.420925 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.421040 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.421257 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.421378 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.421604 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.421715 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.421947 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.422048 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.422290 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.422396 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.422626 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.422733 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.422968 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.423068 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.423333 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.423452 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.423676 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.423788 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.424008 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.424888 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.425152 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.425262 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.425502 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.425612 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.425840 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.425956 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.426191 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.426302 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.426534 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.426644 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.426874 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.426983 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.427222 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.427349 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.427593 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.427704 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.427933 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.428052 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.428275 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.428386 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.428627 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.428737 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.428965 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.429074 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.429307 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.429428 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.429651 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.429761 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.430012 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.430128 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.430353 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.430475 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.430695 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.430805 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.431049 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.431158 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.431417 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.431539 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.431749 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.431849 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.432094 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.432194 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.432427 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.432536 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.432767 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.432873 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.433107 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.433206 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.433448 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.433549 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.433785 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.433885 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.434128 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.434226 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.434457 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.434558 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.434796 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.434895 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.435135 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.435241 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.435545 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.435663 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.435889 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.435989 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.436228 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.436328 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.436566 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.436667 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.436896 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.436995 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.437231 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.437331 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.437576 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.437676 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.437920 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.438020 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.438263 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.438370 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.438603 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.438712 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.438947 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.439047 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.439300 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.439418 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.439645 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.439744 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.440529 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.440640 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.440900 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.441009 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.441252 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.441352 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.441589 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.441717 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.441923 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.442037 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.442254 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.442355 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.442600 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.442700 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.442952 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.443062 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.443353 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.443469 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.443703 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.443804 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.444025 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.444135 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.444387 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.444488 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.444726 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.444826 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.445087 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.445236 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.445400 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.445507 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.445739 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.445839 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.446078 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.446179 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.446413 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.446512 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.446755 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.446862 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.447099 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.447214 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.447457 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.447566 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.447798 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.447906 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.448148 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.448249 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.448492 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.448592 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.448823 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.448930 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.449162 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.449263 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.449505 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.449616 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.449853 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.449960 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.450194 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.450295 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.450529 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.450642 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.450890 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.451052 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.451201 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.451332 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.451569 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.451693 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.451911 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.452031 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.452254 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.452365 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.452590 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.452707 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.452923 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.453033 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.453261 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.453378 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.453595 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.453711 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.453939 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.454072 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.454279 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.454447 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.454626 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.454731 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.454972 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.455073 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.455325 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.455429 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.455700 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.455801 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.456043 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.456144 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.456381 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.456481 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.456742 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.456852 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.457082 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.457167 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.457418 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.457517 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.457755 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.457865 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.458092 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.458192 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.458429 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.458539 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.458775 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.458882 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.459126 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.459233 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.459488 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.459588 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.459835 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.459945 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.460178 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.460276 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.460510 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.460608 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.460855 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.460962 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.461197 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.461307 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.461554 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.461884 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.462009 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.462229 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.462328 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.462579 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.462678 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.462924 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.463032 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.463297 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.463400 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.463641 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.463740 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.464008 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.464119 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.464358 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.464468 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.464698 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.464797 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.465039 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.465146 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.465375 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.465474 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.465717 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.465816 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.466059 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.466167 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.466405 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.466742 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.466842 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.467075 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.467182 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.467441 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.467552 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.467785 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.467885 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.468125 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.468234 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.468462 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.468561 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.468798 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.468897 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.469135 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.469243 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.469484 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.469583 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.469824 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.469922 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.470171 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.470287 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.470511 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.470611 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.470858 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.470956 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.471720 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.471839 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.472062 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.472172 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.472402 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.472501 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.472739 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.472840 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.473080 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.473180 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.473425 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.473531 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.473770 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.473871 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.474114 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.474218 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.474460 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.474576 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.474816 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.474917 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.475153 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.475252 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.475534 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.475646 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.475873 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.475972 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.476209 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.476307 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.476553 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.476719 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.476892 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.476992 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.477221 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.477319 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.477557 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.477668 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.477899 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.477999 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.478239 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.478337 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.478576 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.478687 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.478919 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.479018 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.479257 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.479414 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.479631 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.479741 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.479971 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.480069 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.480311 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.480409 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.480647 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.480748 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.480984 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.481082 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.481317 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.481416 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.481655 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.481755 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.481989 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.482100 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.482336 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.482435 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.482674 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.482780 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.483015 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.483115 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.483383 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.483487 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.483715 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.483815 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.484051 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.484151 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.484406 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.484513 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.484745 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.484845 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.485077 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.485176 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.485413 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.485520 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.485745 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.485845 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.486084 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.486184 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.486414 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.486521 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.486774 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.487381 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.487670 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.487781 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.488010 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.488122 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.488351 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.488456 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.488683 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.488783 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.489022 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.489130 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.489371 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.489471 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.489707 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.489806 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.490050 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.490150 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.490384 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.490482 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.490715 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.490819 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.491051 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.491151 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.491430 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.491546 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.491769 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.491868 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.492118 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.492229 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.492460 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.492559 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.492802 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.492902 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.493142 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.493242 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.493476 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.493576 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.493812 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.493916 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.494152 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.494258 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.494498 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.494597 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.494835 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.494942 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.495170 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.495283 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.495538 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.495638 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.495877 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.495984 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.496223 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.496322 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.496583 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.496682 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.496946 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.497053 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.497302 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.497402 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.497655 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.497767 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.497983 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.498107 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.498321 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.498423 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.498658 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.498765 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.499003 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.499111 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.499386 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.499489 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.499731 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.499831 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.500071 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.500179 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.500415 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.500515 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.500759 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.500864 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.501099 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.501201 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.501442 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.501551 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.501787 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.501887 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.502133 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.502251 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.502489 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.502590 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.502839 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.502945 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.503179 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.503302 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.503543 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.503644 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.503885 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.503992 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.504224 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.504330 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.504570 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.504745 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.504898 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.505055 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.505218 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.505369 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.505566 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.505719 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.505919 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.506078 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.506266 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.506418 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.506613 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.506778 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.506940 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.507102 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.507307 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.507411 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.507622 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.507722 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.507963 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.508079 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.508305 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.508406 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.508651 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.508752 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.509002 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.509104 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.509351 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.509454 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.509694 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.509793 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.510025 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.510178 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.510370 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.510530 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.510735 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.510879 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.511074 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.511225 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.511435 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.511603 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.511777 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.511955 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.512142 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.512314 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.512482 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.512668 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.512842 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.513013 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.513317 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.513490 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.513661 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.513844 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.514056 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.514165 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.514446 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.514546 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.514797 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.514913 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.515141 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.515250 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.515510 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.515620 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.515866 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.515966 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.516205 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.516316 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.516546 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.516645 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.516883 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.516982 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.517220 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.517326 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.517568 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.517667 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.517920 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.518030 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.518290 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.518391 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.518640 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.518740 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.518980 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.519079 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.519365 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.519537 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.519729 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.519888 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.520076 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.520239 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.520436 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.520606 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.520905 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.521004 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.521267 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.521366 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.521614 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.521715 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.521956 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.522061 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.522304 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.522414 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.522638 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.522737 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.522975 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.523081 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.523352 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.523465 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.523694 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.523793 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.524029 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.524128 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.524386 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.524494 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.524731 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.524877 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.525078 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.525177 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.525417 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.525524 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.525762 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.525868 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.526101 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.526205 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.526439 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.526538 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.526800 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.526899 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.527138 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.527237 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.527526 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.527628 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.527885 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.527983 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.528227 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.528331 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.528571 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.528671 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.528904 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.529009 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.529268 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.529373 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.529605 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.529712 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.529944 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.530044 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.530283 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.530382 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.530623 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.530723 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.530966 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.531066 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.531338 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.531451 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.531696 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.531795 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.532033 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.532132 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.532401 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.532508 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.532741 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.532841 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.533100 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.533199 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.533452 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.533559 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.534307 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.534414 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.534656 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.534755 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.535003 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.535141 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.535368 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.535477 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.535705 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.535808 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.536041 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.536143 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.536374 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.536473 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.536712 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.536812 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.537051 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.537152 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.537393 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.537492 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.537729 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.537828 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.538068 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.538194 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.538404 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.538593 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.538764 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.538866 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.539101 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.539209 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.539485 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.539595 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.539824 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.539924 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.540161 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.540275 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.540497 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.540599 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.540827 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.540927 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.541161 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.541276 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.541506 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.541609 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.541849 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.541949 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.542194 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.542301 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.542533 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.542646 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.542871 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.542975 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.543207 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.543343 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.543595 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.543696 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.543941 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.544041 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.544293 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.544402 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.544635 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.544743 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.544981 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.545212 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.545380 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.545526 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.545682 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.545833 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.545992 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.546149 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.546300 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.546449 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.546599 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.546749 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.546906 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.547075 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.547263 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.547441 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.547689 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.547866 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.548037 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.548232 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.548405 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.548550 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.548759 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.548897 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.549913 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.550029 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.550275 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.550376 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.550632 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.550741 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.550988 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.551090 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.551353 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.551457 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.551700 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.551799 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.552043 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.552146 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.552400 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.552500 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.552755 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.552865 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.553109 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.553211 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.553480 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.553699 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.553805 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.554070 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.554171 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.554425 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.554575 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.554778 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.554879 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.555130 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.555232 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.555518 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.555619 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.555851 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.555963 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.556195 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.556296 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.556541 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.556641 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.556880 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.556987 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.557223 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.557324 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.557571 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.557694 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.557916 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.558027 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.558266 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.558365 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.558614 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.558715 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.558956 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.559058 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.559335 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.559440 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.559660 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.559770 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.560020 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.560122 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.560388 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.560490 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.560742 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.560842 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.561082 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.561182 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.561418 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.561518 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.561767 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.561874 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.562117 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.562346 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.562446 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.562693 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.562820 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.563065 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.563173 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.563452 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.563557 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.563805 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.563906 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.564147 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.564248 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.564490 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.564592 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.564843 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.564951 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.565206 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.565305 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.565544 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.565645 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.565890 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.565998 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.566231 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.566331 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.566567 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.566668 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.566918 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.567026 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.567256 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.567531 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.567641 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.567888 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.567994 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.568253 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.568387 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.568614 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.568852 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.568951 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.569242 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.569344 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.569590 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.569690 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.569954 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.570060 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.570304 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.570406 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.570647 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.570747 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.570979 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.571079 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.571346 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.571451 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.571692 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.571803 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.572023 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.572130 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.572374 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.572475 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.572710 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.572843 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.573044 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.573147 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.573381 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.573482 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.573724 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.573982 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.574083 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.574380 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.574489 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.574723 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.574828 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.575063 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.575164 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.575452 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.575564 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.575792 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.575891 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.576135 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.576237 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.576468 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.576576 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.576812 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.576918 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.577149 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.577250 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.577481 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.577582 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.577816 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.577915 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.578154 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.578318 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.578492 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.578592 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.578821 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.578929 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.579161 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.579287 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.579523 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.579624 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.579864 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.579964 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.580194 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.580302 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.580559 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.580664 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.580896 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.580996 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.581236 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.581345 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.581572 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.581673 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.581910 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.582017 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.582245 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.582352 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.582581 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.582682 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.582919 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.583025 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.583263 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.583415 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.583627 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.583735 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.583972 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.584072 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.584318 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.584419 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.584663 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.584912 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.585012 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.585297 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.585411 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.585649 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.585759 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.585992 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.586092 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.586360 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.586467 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.586700 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.586799 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.587035 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.587136 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.587414 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.587531 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.587760 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.587861 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.588101 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.588207 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.588446 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.588548 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.588788 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.588905 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.589126 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.589227 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.589472 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.589574 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.589816 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.590094 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.590201 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.590474 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.590582 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.590811 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.590917 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.591156 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.591263 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.591563 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.591665 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.591904 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.592004 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.592252 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.592352 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.592596 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.592697 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.592948 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.593096 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.593289 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.593391 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.593628 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.593729 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.593968 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.594068 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.594304 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.594410 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.594646 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.594748 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.594995 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.595097 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.595377 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.595493 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.595706 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.595816 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.596048 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.596691 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.596919 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.597027 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.597307 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.597409 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.597667 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.597767 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.598011 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.598124 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.598358 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.598459 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.598713 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.598813 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.599063 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.599171 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.599438 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.599552 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.599773 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.599874 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.600112 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.600214 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.600451 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.600557 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.600794 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.600894 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.601142 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.601244 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.601486 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.601586 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.601851 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.601952 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.602210 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.602312 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.602579 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.602678 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.602930 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.603029 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.603293 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.603398 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.603634 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.603771 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.603980 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.604089 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.604325 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.604432 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.604682 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.604782 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.605039 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.605149 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.605375 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.605476 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.605719 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.605818 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.606059 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.606166 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.606399 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.606499 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.606752 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.606859 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.607092 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.607199 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.607465 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.607578 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.607809 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.607909 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.608157 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.608258 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.608505 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.608611 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.608848 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.608954 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.609191 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.609298 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.609532 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.609638 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.609886 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.609986 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.610222 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.610323 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.610576 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.610677 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.610924 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.611024 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.611321 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.611436 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.611632 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.611732 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.612531 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.612635 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.612872 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.612974 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.613216 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.613317 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.613556 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.613664 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.613899 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.614000 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.614245 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.614352 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.614586 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.614693 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.614948 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.615049 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.615312 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.615417 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.615667 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.615810 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.616008 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.616115 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.616360 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.616460 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.616712 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.616813 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.617059 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.617160 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.617397 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.617503 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.617763 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.617864 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.618102 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.618201 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.618445 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.618544 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.618781 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.618868 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.619132 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.619251 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.619493 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.619614 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.619834 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.619955 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.620192 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.620311 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.620556 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.620685 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.620895 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.621020 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.621258 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.621383 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.621607 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.621735 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.621964 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.622084 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.622313 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.622431 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.622665 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.622793 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.622904 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=84737) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 15 19:43:14.623012 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.623415 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.623727 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.624077 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.624426 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.624783 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.625137 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.625507 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.625874 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.626240 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.626609 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.627001 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.627397 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.627787 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.628162 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:43:14.628440 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=84736) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 15 19:43:14.657693 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG oslo_db.sqlalchemy.engines [None req-2eceb493-8086-4190-b5a6-322c25ed0cfd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=84737) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 15 19:43:14.663635 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG oslo_db.sqlalchemy.engines [None req-97a9b635-85df-41e1-ace9-1e61aa66524d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=84736) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 15 19:43:15.000965 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.context [None req-2eceb493-8086-4190-b5a6-322c25ed0cfd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8e59ab27-c8e0-4643-bc4c-06d479de8174(cell1) {{(pid=84737) load_cells /opt/stack/nova/nova/context.py:466}} Apr 15 19:43:15.006041 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.context [None req-97a9b635-85df-41e1-ace9-1e61aa66524d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8e59ab27-c8e0-4643-bc4c-06d479de8174(cell1) {{(pid=84736) load_cells /opt/stack/nova/nova/context.py:466}} Apr 15 19:43:15.006928 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG oslo_concurrency.lockutils [None req-2eceb493-8086-4190-b5a6-322c25ed0cfd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=84737) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:43:15.008952 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG oslo_concurrency.lockutils [None req-2eceb493-8086-4190-b5a6-322c25ed0cfd None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=84737) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:43:15.009827 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG oslo_concurrency.lockutils [None req-2eceb493-8086-4190-b5a6-322c25ed0cfd None None] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=84737) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:43:15.011497 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG oslo_concurrency.lockutils [None req-97a9b635-85df-41e1-ace9-1e61aa66524d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=84736) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:43:15.011973 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG oslo_concurrency.lockutils [None req-2eceb493-8086-4190-b5a6-322c25ed0cfd None None] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=84737) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:43:15.013462 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG oslo_concurrency.lockutils [None req-97a9b635-85df-41e1-ace9-1e61aa66524d None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=84736) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:43:15.014342 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG oslo_concurrency.lockutils [None req-97a9b635-85df-41e1-ace9-1e61aa66524d None None] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=84736) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:43:15.016514 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG oslo_concurrency.lockutils [None req-97a9b635-85df-41e1-ace9-1e61aa66524d None None] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=84736) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:43:15.036952 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG oslo_db.sqlalchemy.engines [None req-2eceb493-8086-4190-b5a6-322c25ed0cfd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=84737) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 15 19:43:15.043389 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG oslo_db.sqlalchemy.engines [None req-97a9b635-85df-41e1-ace9-1e61aa66524d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=84736) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 15 19:43:15.044421 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG oslo_db.sqlalchemy.engines [None req-97a9b635-85df-41e1-ace9-1e61aa66524d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=84736) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 15 19:43:15.044548 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG oslo_db.sqlalchemy.engines [None req-2eceb493-8086-4190-b5a6-322c25ed0cfd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=84737) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 15 19:43:15.070880 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG oslo_db.sqlalchemy.engines [None req-2eceb493-8086-4190-b5a6-322c25ed0cfd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=84737) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 15 19:43:15.075654 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG oslo_db.sqlalchemy.engines [None req-97a9b635-85df-41e1-ace9-1e61aa66524d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=84736) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 15 19:43:15.169144 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 15 19:43:15.169144 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: from cryptography.utils import int_from_bytes Apr 15 19:43:15.169529 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 15 19:43:15.169529 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: from cryptography.utils import int_from_bytes Apr 15 19:43:15.169938 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 15 19:43:15.169938 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: from cryptography.utils import int_from_bytes Apr 15 19:43:15.170324 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 15 19:43:15.170324 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: from cryptography.utils import int_from_bytes Apr 15 19:43:15.248466 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO keyring.backend [None req-97a9b635-85df-41e1-ace9-1e61aa66524d None None] Loading Gnome Apr 15 19:43:15.248655 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO keyring.backend [None req-2eceb493-8086-4190-b5a6-322c25ed0cfd None None] Loading Gnome Apr 15 19:43:15.269254 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO keyring.backend [None req-97a9b635-85df-41e1-ace9-1e61aa66524d None None] Loading Google Apr 15 19:43:15.269394 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO keyring.backend [None req-2eceb493-8086-4190-b5a6-322c25ed0cfd None None] Loading Google Apr 15 19:43:15.272507 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO keyring.backend [None req-2eceb493-8086-4190-b5a6-322c25ed0cfd None None] Loading Windows (alt) Apr 15 19:43:15.272738 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO keyring.backend [None req-97a9b635-85df-41e1-ace9-1e61aa66524d None None] Loading Windows (alt) Apr 15 19:43:15.277315 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO keyring.backend [None req-2eceb493-8086-4190-b5a6-322c25ed0cfd None None] Loading file Apr 15 19:43:15.277443 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO keyring.backend [None req-97a9b635-85df-41e1-ace9-1e61aa66524d None None] Loading file Apr 15 19:43:15.278417 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO keyring.backend [None req-2eceb493-8086-4190-b5a6-322c25ed0cfd None None] Loading keyczar Apr 15 19:43:15.278528 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO keyring.backend [None req-97a9b635-85df-41e1-ace9-1e61aa66524d None None] Loading keyczar Apr 15 19:43:15.278861 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO keyring.backend [None req-97a9b635-85df-41e1-ace9-1e61aa66524d None None] Loading multi Apr 15 19:43:15.278964 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO keyring.backend [None req-2eceb493-8086-4190-b5a6-322c25ed0cfd None None] Loading multi Apr 15 19:43:15.279764 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO keyring.backend [None req-97a9b635-85df-41e1-ace9-1e61aa66524d None None] Loading pyfs Apr 15 19:43:15.279870 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO keyring.backend [None req-2eceb493-8086-4190-b5a6-322c25ed0cfd None None] Loading pyfs Apr 15 19:43:15.563136 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: WARNING keystonemiddleware.auth_token [None req-97a9b635-85df-41e1-ace9-1e61aa66524d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 15 19:43:15.563771 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: WARNING keystonemiddleware.auth_token [None req-2eceb493-8086-4190-b5a6-322c25ed0cfd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 15 19:43:15.570393 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: WARNING keystonemiddleware.auth_token [None req-97a9b635-85df-41e1-ace9-1e61aa66524d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 15 19:43:15.570998 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: WARNING keystonemiddleware.auth_token [None req-2eceb493-8086-4190-b5a6-322c25ed0cfd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 15 19:43:15.904665 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: WARNING keystonemiddleware.auth_token [None req-97a9b635-85df-41e1-ace9-1e61aa66524d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 15 19:43:15.906093 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: WARNING keystonemiddleware.auth_token [None req-2eceb493-8086-4190-b5a6-322c25ed0cfd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 15 19:43:15.910819 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: WARNING keystonemiddleware.auth_token [None req-97a9b635-85df-41e1-ace9-1e61aa66524d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 15 19:43:15.912386 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: WARNING keystonemiddleware.auth_token [None req-2eceb493-8086-4190-b5a6-322c25ed0cfd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 15 19:43:15.917246 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560aabbfe9c0 pid: 84736 (default app) Apr 15 19:43:15.918782 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560aabbfe9c0 pid: 84737 (default app) Apr 15 19:43:15.919492 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-97a9b635-85df-41e1-ace9-1e61aa66524d None None] Calling method '>' {{(pid=84736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:43:15.920681 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-97a9b635-85df-41e1-ace9-1e61aa66524d None None] 10.222.0.58 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001812 Apr 15 19:43:15.921120 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84736|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 779 bytes} [Thu Apr 15 19:43:15 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:44:41.200120 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-2eceb493-8086-4190-b5a6-322c25ed0cfd None None] Calling method '>' {{(pid=84737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:44:41.201342 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-2eceb493-8086-4190-b5a6-322c25ed0cfd None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002043 Apr 15 19:44:41.201977 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84737|app: 0|req: 1/2] 10.222.0.58 () {54 vars in 920 bytes} [Thu Apr 15 19:44:41 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:44:41.686294 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-36c38967-f730-4775-9e6a-a62bff5325a7 admin admin] Calling method '>' {{(pid=84736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:44:41.713434 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-36c38967-f730-4775-9e6a-a62bff5325a7 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.504062 Apr 15 19:44:41.717810 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84736|app: 0|req: 2/3] 10.222.0.58 () {60 vars in 1281 bytes} [Thu Apr 15 19:44:41 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:44:44.196803 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-2eceb493-8086-4190-b5a6-322c25ed0cfd None None] Calling method '>' {{(pid=84737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:44:44.197883 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-2eceb493-8086-4190-b5a6-322c25ed0cfd None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Apr 15 19:44:44.198321 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84737|app: 0|req: 2/4] 10.222.0.58 () {54 vars in 920 bytes} [Thu Apr 15 19:44:44 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:44:44.264969 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-b7025d84-c073-40c7-9512-8232da696411 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "id": "c1", "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=84736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:44:44.288808 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:44:44.288808 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: warnings.warn(msg) Apr 15 19:44:44.316787 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-b7025d84-c073-40c7-9512-8232da696411 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.111734 Apr 15 19:44:44.317302 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84736|app: 0|req: 3/5] 10.222.0.58 () {64 vars in 1272 bytes} [Thu Apr 15 19:44:44 2021] POST /compute/v2.1/flavors => generated 407 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:44:44.639227 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-db0eea0b-1525-4927-82c1-ef47478cc4a3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=84737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:44:44.642700 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:44:44.642700 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: warnings.warn(msg) Apr 15 19:44:44.694642 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-db0eea0b-1525-4927-82c1-ef47478cc4a3 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.367693 Apr 15 19:44:44.695684 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84737|app: 0|req: 3/6] 10.222.0.58 () {64 vars in 1325 bytes} [Thu Apr 15 19:44:44 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:44:47.207388 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-b7025d84-c073-40c7-9512-8232da696411 admin admin] Calling method '>' {{(pid=84736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:44:47.209023 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-b7025d84-c073-40c7-9512-8232da696411 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002132 Apr 15 19:44:47.209662 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84736|app: 0|req: 4/7] 10.222.0.58 () {54 vars in 920 bytes} [Thu Apr 15 19:44:47 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:44:47.330777 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-2828094a-a523-4a4a-b033-0c614ef637a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 5, "vcpus": 1}} {{(pid=84737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:44:47.353619 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:44:47.353619 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: warnings.warn(msg) Apr 15 19:44:47.383378 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-2828094a-a523-4a4a-b033-0c614ef637a6 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.167021 Apr 15 19:44:47.384068 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84737|app: 0|req: 4/8] 10.222.0.58 () {64 vars in 1272 bytes} [Thu Apr 15 19:44:47 2021] POST /compute/v2.1/flavors => generated 404 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:44:47.397005 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-d52a2520-e2d2-4616-a478-7ecca9adb45c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=84736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:44:47.398617 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:44:47.398617 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: warnings.warn(msg) Apr 15 19:44:47.437268 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-d52a2520-e2d2-4616-a478-7ecca9adb45c admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044116 Apr 15 19:44:47.438888 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84736|app: 0|req: 5/9] 10.222.0.58 () {64 vars in 1325 bytes} [Thu Apr 15 19:44:47 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:44:49.965769 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-2828094a-a523-4a4a-b033-0c614ef637a6 admin admin] Calling method '>' {{(pid=84737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:44:49.966874 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-2828094a-a523-4a4a-b033-0c614ef637a6 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001600 Apr 15 19:44:49.967554 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84737|app: 0|req: 5/10] 10.222.0.58 () {54 vars in 920 bytes} [Thu Apr 15 19:44:49 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:44:50.033544 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-c5a5dd8c-e352-42ba-a2ad-ccdc8d962ee2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "disk": 10, "id": "d2", "name": "ds1G", "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=84736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:44:50.060669 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-c5a5dd8c-e352-42ba-a2ad-ccdc8d962ee2 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.086047 Apr 15 19:44:50.061244 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84736|app: 0|req: 6/11] 10.222.0.58 () {64 vars in 1272 bytes} [Thu Apr 15 19:44:49 2021] POST /compute/v2.1/flavors => generated 404 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 15 19:44:50.074773 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-5b5847c6-3b19-4d82-9867-880cbb973248 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=84737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:44:50.113200 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-5b5847c6-3b19-4d82-9867-880cbb973248 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042501 Apr 15 19:44:50.114164 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84737|app: 0|req: 6/12] 10.222.0.58 () {64 vars in 1325 bytes} [Thu Apr 15 19:44:50 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:44:52.664016 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-c5a5dd8c-e352-42ba-a2ad-ccdc8d962ee2 admin admin] Calling method '>' {{(pid=84736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:44:52.665652 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-c5a5dd8c-e352-42ba-a2ad-ccdc8d962ee2 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002137 Apr 15 19:44:52.666065 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84736|app: 0|req: 7/13] 10.222.0.58 () {54 vars in 920 bytes} [Thu Apr 15 19:44:52 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:44:52.729890 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-7dff4a84-99cd-47d5-a70e-1118975475a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d3", "swap": 0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10, "vcpus": 2, "ram": 2048}} {{(pid=84737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:44:52.761234 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-7dff4a84-99cd-47d5-a70e-1118975475a9 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.088937 Apr 15 19:44:52.762242 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84737|app: 0|req: 7/14] 10.222.0.58 () {64 vars in 1272 bytes} [Thu Apr 15 19:44:52 2021] POST /compute/v2.1/flavors => generated 404 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:44:52.774567 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-2003f72e-3d56-4f9d-9cf4-d497e738ed48 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=84736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:44:52.810423 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-2003f72e-3d56-4f9d-9cf4-d497e738ed48 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039921 Apr 15 19:44:52.811011 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84736|app: 0|req: 8/15] 10.222.0.58 () {64 vars in 1325 bytes} [Thu Apr 15 19:44:52 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:44:55.337072 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-7dff4a84-99cd-47d5-a70e-1118975475a9 admin admin] Calling method '>' {{(pid=84737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:44:55.338143 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-7dff4a84-99cd-47d5-a70e-1118975475a9 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Apr 15 19:44:55.338570 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84737|app: 0|req: 8/16] 10.222.0.58 () {54 vars in 920 bytes} [Thu Apr 15 19:44:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:44:55.401383 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-89236203-1e64-41a2-b44c-938bbe43cc0c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "vcpus": 4, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "ram": 4096, "name": "ds4G"}} {{(pid=84736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:44:55.426609 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-89236203-1e64-41a2-b44c-938bbe43cc0c admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.081565 Apr 15 19:44:55.427180 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84736|app: 0|req: 9/17] 10.222.0.58 () {64 vars in 1272 bytes} [Thu Apr 15 19:44:55 2021] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:44:55.440302 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-e301f6cf-de29-4cd9-95d7-a185d04a47ff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=84737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:44:55.476466 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-e301f6cf-de29-4cd9-95d7-a185d04a47ff admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040615 Apr 15 19:44:55.477086 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84737|app: 0|req: 9/18] 10.222.0.58 () {64 vars in 1325 bytes} [Thu Apr 15 19:44:55 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:44:58.042467 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-89236203-1e64-41a2-b44c-938bbe43cc0c admin admin] Calling method '>' {{(pid=84736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:44:58.043637 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-89236203-1e64-41a2-b44c-938bbe43cc0c admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001650 Apr 15 19:44:58.044109 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84736|app: 0|req: 10/19] 10.222.0.58 () {54 vars in 920 bytes} [Thu Apr 15 19:44:58 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:44:58.111512 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-3e9d4e65-f00b-4708-bfb2-d19168c429db admin admin] Calling method '>' {{(pid=84737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:44:58.144744 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-3e9d4e65-f00b-4708-bfb2-d19168c429db admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.092670 Apr 15 19:44:58.145833 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84737|app: 0|req: 10/20] 10.222.0.58 () {60 vars in 1281 bytes} [Thu Apr 15 19:44:58 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:45:00.616840 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-89236203-1e64-41a2-b44c-938bbe43cc0c admin admin] Calling method '>' {{(pid=84736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:45:00.617979 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-89236203-1e64-41a2-b44c-938bbe43cc0c admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001691 Apr 15 19:45:00.618465 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84736|app: 0|req: 11/21] 10.222.0.58 () {54 vars in 920 bytes} [Thu Apr 15 19:45:00 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:45:00.681264 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-b73ff684-8cfb-4f2a-a059-e95398b72ba1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "ram": 512}} {{(pid=84737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:45:00.705694 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-b73ff684-8cfb-4f2a-a059-e95398b72ba1 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.080974 Apr 15 19:45:00.711296 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84737|app: 0|req: 11/22] 10.222.0.58 () {64 vars in 1272 bytes} [Thu Apr 15 19:45:00 2021] POST /compute/v2.1/flavors => generated 402 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:45:00.720800 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-e38b6b3c-9e33-45c7-b4ae-0c4b1f097330 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=84736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:45:00.755720 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-e38b6b3c-9e33-45c7-b4ae-0c4b1f097330 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040022 Apr 15 19:45:00.756328 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84736|app: 0|req: 12/23] 10.222.0.58 () {64 vars in 1322 bytes} [Thu Apr 15 19:45:00 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:45:03.633375 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-b73ff684-8cfb-4f2a-a059-e95398b72ba1 admin admin] Calling method '>' {{(pid=84737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:45:03.634450 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-b73ff684-8cfb-4f2a-a059-e95398b72ba1 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Apr 15 19:45:03.634896 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84737|app: 0|req: 12/24] 10.222.0.58 () {54 vars in 920 bytes} [Thu Apr 15 19:45:03 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:45:03.695917 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-64bec603-7a87-4d34-9a97-900296db3499 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "name": "m1.small", "disk": 20, "swap": 0, "rxtx_factor": 1.0, "id": "2", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=84736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:45:03.723938 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-64bec603-7a87-4d34-9a97-900296db3499 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.081919 Apr 15 19:45:03.724944 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84736|app: 0|req: 13/25] 10.222.0.58 () {64 vars in 1272 bytes} [Thu Apr 15 19:45:03 2021] POST /compute/v2.1/flavors => generated 405 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:45:03.738053 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-e21bf008-6e26-4138-be0f-986c05b8fc38 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=84737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:45:03.776254 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-e21bf008-6e26-4138-be0f-986c05b8fc38 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042228 Apr 15 19:45:03.784466 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84737|app: 0|req: 13/26] 10.222.0.58 () {64 vars in 1322 bytes} [Thu Apr 15 19:45:03 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:45:06.274771 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-64bec603-7a87-4d34-9a97-900296db3499 admin admin] Calling method '>' {{(pid=84736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:45:06.275848 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-64bec603-7a87-4d34-9a97-900296db3499 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001583 Apr 15 19:45:06.276496 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84736|app: 0|req: 14/27] 10.222.0.58 () {54 vars in 920 bytes} [Thu Apr 15 19:45:06 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:45:06.344609 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-dcab11a1-1bcd-430a-a494-4eefed040c73 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "disk": 40, "id": "3", "vcpus": 2, "name": "m1.medium", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=84737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:45:06.371689 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-dcab11a1-1bcd-430a-a494-4eefed040c73 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.088233 Apr 15 19:45:06.372261 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84737|app: 0|req: 14/28] 10.222.0.58 () {64 vars in 1272 bytes} [Thu Apr 15 19:45:06 2021] POST /compute/v2.1/flavors => generated 406 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:45:06.385416 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-cc24bc6a-ba74-4852-b015-2cf321737e5e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=84736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:45:06.426130 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-cc24bc6a-ba74-4852-b015-2cf321737e5e admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044483 Apr 15 19:45:06.427030 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84736|app: 0|req: 15/29] 10.222.0.58 () {64 vars in 1322 bytes} [Thu Apr 15 19:45:06 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:45:08.954440 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-dcab11a1-1bcd-430a-a494-4eefed040c73 admin admin] Calling method '>' {{(pid=84737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:45:08.955596 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-dcab11a1-1bcd-430a-a494-4eefed040c73 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003281 Apr 15 19:45:08.956021 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84737|app: 0|req: 15/30] 10.222.0.58 () {54 vars in 920 bytes} [Thu Apr 15 19:45:08 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:45:09.021055 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-e378fc14-ddd2-48a3-b09d-9421fc2c29cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "ram": 8192, "disk": 80, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=84736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:45:09.047073 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-e378fc14-ddd2-48a3-b09d-9421fc2c29cf admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.084549 Apr 15 19:45:09.047675 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84736|app: 0|req: 16/31] 10.222.0.58 () {64 vars in 1272 bytes} [Thu Apr 15 19:45:08 2021] POST /compute/v2.1/flavors => generated 405 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 15 19:45:09.062879 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-09179ddd-a65c-4c94-883f-f90e4d7f53f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=84737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:45:09.102603 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-09179ddd-a65c-4c94-883f-f90e4d7f53f3 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043784 Apr 15 19:45:09.103233 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84737|app: 0|req: 16/32] 10.222.0.58 () {64 vars in 1322 bytes} [Thu Apr 15 19:45:09 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:45:11.652614 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-e378fc14-ddd2-48a3-b09d-9421fc2c29cf admin admin] Calling method '>' {{(pid=84736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:45:11.653689 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-e378fc14-ddd2-48a3-b09d-9421fc2c29cf admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001557 Apr 15 19:45:11.654140 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84736|app: 0|req: 17/33] 10.222.0.58 () {54 vars in 920 bytes} [Thu Apr 15 19:45:11 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:45:11.733432 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-634f7e31-72a2-4e6f-9084-b245ff8c251e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "os-flavor-access:is_public": true, "disk": 160, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "rxtx_factor": 1.0, "name": "m1.xlarge", "id": "5"}} {{(pid=84737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:45:11.757929 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-634f7e31-72a2-4e6f-9084-b245ff8c251e admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.096783 Apr 15 19:45:11.762898 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84737|app: 0|req: 17/34] 10.222.0.58 () {64 vars in 1272 bytes} [Thu Apr 15 19:45:11 2021] POST /compute/v2.1/flavors => generated 408 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:45:11.771474 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-afb3bf76-299b-42af-8835-4e020ffd504b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=84736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:45:11.811174 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-afb3bf76-299b-42af-8835-4e020ffd504b admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043713 Apr 15 19:45:11.812074 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84736|app: 0|req: 18/35] 10.222.0.58 () {64 vars in 1322 bytes} [Thu Apr 15 19:45:11 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:45:51.724432 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-634f7e31-72a2-4e6f-9084-b245ff8c251e admin admin] Calling method '>' {{(pid=84737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:45:51.725501 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-634f7e31-72a2-4e6f-9084-b245ff8c251e admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001567 Apr 15 19:45:51.725938 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84737|app: 0|req: 18/36] 10.222.0.58 () {54 vars in 920 bytes} [Thu Apr 15 19:45:51 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:45:51.785943 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-e340bead-4453-47b1-9bc9-54dd29c270d1 admin admin] Calling method '>' {{(pid=84736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:45:51.812003 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-e340bead-4453-47b1-9bc9-54dd29c270d1 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.079113 Apr 15 19:45:51.812560 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84736|app: 0|req: 19/37] 10.222.0.58 () {60 vars in 1281 bytes} [Thu Apr 15 19:45:51 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:45:53.474152 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-634f7e31-72a2-4e6f-9084-b245ff8c251e admin admin] Calling method '>' {{(pid=84737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:45:53.475211 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-634f7e31-72a2-4e6f-9084-b245ff8c251e admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Apr 15 19:45:53.475668 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84737|app: 0|req: 19/38] 10.222.0.58 () {56 vars in 1065 bytes} [Thu Apr 15 19:45:53 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:45:53.656441 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-72f1d316-55cf-4600-9fef-78e5555451e6 admin admin] Calling method '>' {{(pid=84736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:45:53.670588 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.wsgi [None req-72f1d316-55cf-4600-9fef-78e5555451e6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 15 19:45:53.671214 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-72f1d316-55cf-4600-9fef-78e5555451e6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=84736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 19:45:53.672113 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-72f1d316-55cf-4600-9fef-78e5555451e6 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.069209 Apr 15 19:45:53.672919 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84736|app: 0|req: 20/39] 10.222.0.58 () {60 vars in 1181 bytes} [Thu Apr 15 19:45:53 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 15 19:45:53.682937 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-226417ba-be48-4a28-bacd-c0ecee8b4c71 admin admin] Calling method '>' {{(pid=84737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:45:53.705401 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-226417ba-be48-4a28-bacd-c0ecee8b4c71 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026373 Apr 15 19:45:53.705985 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84737|app: 0|req: 20/40] 10.222.0.58 () {60 vars in 1201 bytes} [Thu Apr 15 19:45:53 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:45:53.716344 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-70a8aee2-81ff-47f4-aa08-f57d8421ed32 admin admin] Calling method '>' {{(pid=84736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:45:53.737601 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-70a8aee2-81ff-47f4-aa08-f57d8421ed32 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025046 Apr 15 19:45:53.738152 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84736|app: 0|req: 21/41] 10.222.0.58 () {60 vars in 1201 bytes} [Thu Apr 15 19:45:53 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:45:53.747967 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-82a42a7d-6426-45af-96bb-7c56e0240b04 admin admin] Calling method '>' {{(pid=84737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:45:53.762456 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.wsgi [None req-82a42a7d-6426-45af-96bb-7c56e0240b04 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 15 19:45:53.763076 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-82a42a7d-6426-45af-96bb-7c56e0240b04 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=84737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 19:45:53.763939 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-82a42a7d-6426-45af-96bb-7c56e0240b04 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.019814 Apr 15 19:45:53.765041 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84737|app: 0|req: 21/42] 10.222.0.58 () {60 vars in 1181 bytes} [Thu Apr 15 19:45:53 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 15 19:45:55.307015 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-70a8aee2-81ff-47f4-aa08-f57d8421ed32 admin admin] Calling method '>' {{(pid=84736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:45:55.308144 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-70a8aee2-81ff-47f4-aa08-f57d8421ed32 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001586 Apr 15 19:45:55.308579 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84736|app: 0|req: 22/43] 10.222.0.58 () {56 vars in 1065 bytes} [Thu Apr 15 19:45:55 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:45:55.488633 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-b60bbcc2-5bad-4b82-919d-bd3a4dc763e4 admin admin] Calling method '>' {{(pid=84737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:45:55.501221 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.wsgi [None req-b60bbcc2-5bad-4b82-919d-bd3a4dc763e4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 15 19:45:55.501817 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-b60bbcc2-5bad-4b82-919d-bd3a4dc763e4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=84737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 19:45:55.502646 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-b60bbcc2-5bad-4b82-919d-bd3a4dc763e4 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.067230 Apr 15 19:45:55.503186 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84737|app: 0|req: 22/44] 10.222.0.58 () {60 vars in 1181 bytes} [Thu Apr 15 19:45:55 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 15 19:45:55.513156 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-bcbbf7ff-ed4c-431a-b5f7-f6815ce7d49f admin admin] Calling method '>' {{(pid=84736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:45:55.535583 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-bcbbf7ff-ed4c-431a-b5f7-f6815ce7d49f admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026381 Apr 15 19:45:55.536145 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84736|app: 0|req: 23/45] 10.222.0.58 () {60 vars in 1201 bytes} [Thu Apr 15 19:45:55 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:45:55.546192 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-fb1ff277-d4aa-404b-b734-31393fc58984 admin admin] Calling method '>' {{(pid=84737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:45:55.567701 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-fb1ff277-d4aa-404b-b734-31393fc58984 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025229 Apr 15 19:45:55.568268 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84737|app: 0|req: 23/46] 10.222.0.58 () {60 vars in 1201 bytes} [Thu Apr 15 19:45:55 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:45:55.578253 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-77b945fd-04dd-46b7-a123-c561981417e7 admin admin] Calling method '>' {{(pid=84736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:45:55.590742 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.wsgi [None req-77b945fd-04dd-46b7-a123-c561981417e7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 15 19:45:55.591380 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-77b945fd-04dd-46b7-a123-c561981417e7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=84736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 19:45:55.592210 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-77b945fd-04dd-46b7-a123-c561981417e7 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.018117 Apr 15 19:45:55.593301 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84736|app: 0|req: 24/47] 10.222.0.58 () {60 vars in 1181 bytes} [Thu Apr 15 19:45:55 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 15 19:45:57.146012 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-fb1ff277-d4aa-404b-b734-31393fc58984 admin admin] Calling method '>' {{(pid=84737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:45:57.147098 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-fb1ff277-d4aa-404b-b734-31393fc58984 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Apr 15 19:45:57.147583 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84737|app: 0|req: 24/48] 10.222.0.58 () {56 vars in 1065 bytes} [Thu Apr 15 19:45:57 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:45:57.326488 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-181dd53a-aec3-4864-a9fd-dd712c70bc95 admin admin] Calling method '>' {{(pid=84736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:45:57.339917 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.wsgi [None req-181dd53a-aec3-4864-a9fd-dd712c70bc95 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 15 19:45:57.340526 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-181dd53a-aec3-4864-a9fd-dd712c70bc95 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=84736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 19:45:57.341360 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-181dd53a-aec3-4864-a9fd-dd712c70bc95 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.067952 Apr 15 19:45:57.341897 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84736|app: 0|req: 25/49] 10.222.0.58 () {60 vars in 1184 bytes} [Thu Apr 15 19:45:57 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 15 19:45:57.352384 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-390d56de-675c-43e7-bcd2-a881a1fb8f29 admin admin] Calling method '>' {{(pid=84737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:45:57.374770 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-390d56de-675c-43e7-bcd2-a881a1fb8f29 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026378 Apr 15 19:45:57.375357 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84737|app: 0|req: 25/50] 10.222.0.58 () {60 vars in 1201 bytes} [Thu Apr 15 19:45:57 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:45:57.385046 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-92204c99-bf15-43d0-ae38-5be72d11f2c1 admin admin] Calling method '>' {{(pid=84736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:45:57.406601 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-92204c99-bf15-43d0-ae38-5be72d11f2c1 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025218 Apr 15 19:45:57.407154 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84736|app: 0|req: 26/51] 10.222.0.58 () {60 vars in 1201 bytes} [Thu Apr 15 19:45:57 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:45:57.416636 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-79bf1a42-d763-45fd-bc04-9114300ee137 admin admin] Calling method '>' {{(pid=84737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:45:57.429381 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.wsgi [None req-79bf1a42-d763-45fd-bc04-9114300ee137 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 15 19:45:57.429984 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-79bf1a42-d763-45fd-bc04-9114300ee137 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=84737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 19:45:57.430810 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-79bf1a42-d763-45fd-bc04-9114300ee137 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.017902 Apr 15 19:45:57.431375 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84737|app: 0|req: 26/52] 10.222.0.58 () {60 vars in 1184 bytes} [Thu Apr 15 19:45:57 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 15 19:45:58.980384 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-92204c99-bf15-43d0-ae38-5be72d11f2c1 admin admin] Calling method '>' {{(pid=84736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:45:58.981438 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-92204c99-bf15-43d0-ae38-5be72d11f2c1 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Apr 15 19:45:58.981901 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84736|app: 0|req: 27/53] 10.222.0.58 () {56 vars in 1065 bytes} [Thu Apr 15 19:45:58 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:45:59.163050 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-6a43c6d6-4995-4c41-b3d7-0405c3a2b744 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=84737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:45:59.186535 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-6a43c6d6-4995-4c41-b3d7-0405c3a2b744 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.076982 Apr 15 19:45:59.187114 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84737|app: 0|req: 27/54] 10.222.0.58 () {64 vars in 1226 bytes} [Thu Apr 15 19:45:59 2021] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:46:00.732177 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-92204c99-bf15-43d0-ae38-5be72d11f2c1 admin admin] Calling method '>' {{(pid=84736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:46:00.733236 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-92204c99-bf15-43d0-ae38-5be72d11f2c1 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Apr 15 19:46:00.733665 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84736|app: 0|req: 28/55] 10.222.0.58 () {56 vars in 1065 bytes} [Thu Apr 15 19:46:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:46:00.914858 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-434dc47b-27de-4d8f-b704-b441a7b7a9cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=84737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:46:00.938557 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-434dc47b-27de-4d8f-b704-b441a7b7a9cb admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.077346 Apr 15 19:46:00.939076 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84737|app: 0|req: 28/56] 10.222.0.58 () {64 vars in 1226 bytes} [Thu Apr 15 19:46:00 2021] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:46:02.492114 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-92204c99-bf15-43d0-ae38-5be72d11f2c1 admin admin] Calling method '>' {{(pid=84736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:46:02.493161 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-92204c99-bf15-43d0-ae38-5be72d11f2c1 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Apr 15 19:46:02.493587 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84736|app: 0|req: 29/57] 10.222.0.58 () {56 vars in 1065 bytes} [Thu Apr 15 19:46:02 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:46:02.673882 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-3dc8cc39-e8d5-4a1c-bbe7-d6e1450a1639 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=84737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:46:02.697704 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-3dc8cc39-e8d5-4a1c-bbe7-d6e1450a1639 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.077620 Apr 15 19:46:02.698226 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84737|app: 0|req: 29/58] 10.222.0.58 () {64 vars in 1226 bytes} [Thu Apr 15 19:46:02 2021] POST /compute/v2.1/flavors => generated 407 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:46:04.251746 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-92204c99-bf15-43d0-ae38-5be72d11f2c1 admin admin] Calling method '>' {{(pid=84736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:46:04.252796 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-92204c99-bf15-43d0-ae38-5be72d11f2c1 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Apr 15 19:46:04.253226 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84736|app: 0|req: 30/59] 10.222.0.58 () {56 vars in 1065 bytes} [Thu Apr 15 19:46:04 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:46:04.434789 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-4c16918b-ee38-40b3-b5ac-f19f5ad1f14d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=84737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:46:04.461266 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-4c16918b-ee38-40b3-b5ac-f19f5ad1f14d admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.079838 Apr 15 19:46:04.461775 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84737|app: 0|req: 30/60] 10.222.0.58 () {64 vars in 1226 bytes} [Thu Apr 15 19:46:04 2021] POST /compute/v2.1/flavors => generated 409 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:46:06.023055 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-92204c99-bf15-43d0-ae38-5be72d11f2c1 admin admin] Calling method '>' {{(pid=84736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:46:06.024134 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-92204c99-bf15-43d0-ae38-5be72d11f2c1 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Apr 15 19:46:06.024567 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84736|app: 0|req: 31/61] 10.222.0.58 () {56 vars in 1065 bytes} [Thu Apr 15 19:46:06 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:46:06.206732 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-8234c054-8c13-4928-944f-609e9566beed admin admin] Calling method '>' {{(pid=84737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:46:06.234277 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-8234c054-8c13-4928-944f-609e9566beed admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.081625 Apr 15 19:46:06.234819 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84737|app: 0|req: 31/62] 10.222.0.58 () {60 vars in 1193 bytes} [Thu Apr 15 19:46:06 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:46:56.605742 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-92204c99-bf15-43d0-ae38-5be72d11f2c1 admin admin] Calling method '>' {{(pid=84736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:46:56.606793 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-92204c99-bf15-43d0-ae38-5be72d11f2c1 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Apr 15 19:46:56.607223 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84736|app: 0|req: 32/63] 10.222.0.58 () {56 vars in 1065 bytes} [Thu Apr 15 19:46:56 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:46:56.789259 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-2497c255-baaf-44a2-95ab-45e3ef14c884 admin admin] Calling method '>' {{(pid=84737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:46:56.817923 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-2497c255-baaf-44a2-95ab-45e3ef14c884 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.082474 Apr 15 19:46:56.818435 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84737|app: 0|req: 32/64] 10.222.0.58 () {60 vars in 1193 bytes} [Thu Apr 15 19:46:56 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:48:21.420371 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-adbce79f-9fae-4464-b76d-59c9baec47ff tempest-verify_tempest_config-1717238867 tempest-verify_tempest_config-1717238867-project] Calling method '>' {{(pid=84736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:48:21.422673 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-adbce79f-9fae-4464-b76d-59c9baec47ff tempest-verify_tempest_config-1717238867 tempest-verify_tempest_config-1717238867-project] 10.222.0.58 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.121088 Apr 15 19:48:21.423244 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84736|app: 0|req: 33/65] 10.222.0.58 () {58 vars in 1124 bytes} [Thu Apr 15 19:48:21 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:49:54.898793 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-2497c255-baaf-44a2-95ab-45e3ef14c884 admin admin] Calling method '>' {{(pid=84737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:49:54.899967 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-2497c255-baaf-44a2-95ab-45e3ef14c884 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001585 Apr 15 19:49:54.900397 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84737|app: 0|req: 33/66] 10.222.0.58 () {56 vars in 1065 bytes} [Thu Apr 15 19:49:54 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:49:55.151850 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-2b171319-129d-4842-9609-491fdf790764 admin admin] Calling method '>' {{(pid=84736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:49:55.153206 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:49:55.153206 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: warnings.warn(msg) Apr 15 19:49:55.155329 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG oslo_concurrency.lockutils [None req-2b171319-129d-4842-9609-491fdf790764 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=84736) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:49:55.155823 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG oslo_concurrency.lockutils [None req-2b171319-129d-4842-9609-491fdf790764 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=84736) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:49:55.156672 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG oslo_concurrency.lockutils [None req-2b171319-129d-4842-9609-491fdf790764 admin admin] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=84736) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:49:55.157147 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG oslo_concurrency.lockutils [None req-2b171319-129d-4842-9609-491fdf790764 admin admin] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=84736) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:49:55.195965 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-2b171319-129d-4842-9609-491fdf790764 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.168594 Apr 15 19:49:55.196547 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84736|app: 0|req: 34/67] 10.222.0.58 () {60 vars in 1184 bytes} [Thu Apr 15 19:49:55 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:49:56.767708 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-2497c255-baaf-44a2-95ab-45e3ef14c884 admin admin] Calling method '>' {{(pid=84737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:49:56.768765 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-2497c255-baaf-44a2-95ab-45e3ef14c884 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Apr 15 19:49:56.769200 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84737|app: 0|req: 34/68] 10.222.0.58 () {56 vars in 1065 bytes} [Thu Apr 15 19:49:56 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:49:56.949954 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG nova.api.openstack.wsgi [None req-aaa1227b-c5b6-4e21-9765-adb76d731ad0 admin admin] Calling method '>' {{(pid=84736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:49:56.951804 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:49:56.951804 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: warnings.warn(msg) Apr 15 19:49:56.953412 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG oslo_concurrency.lockutils [None req-aaa1227b-c5b6-4e21-9765-adb76d731ad0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=84736) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:49:56.953898 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG oslo_concurrency.lockutils [None req-aaa1227b-c5b6-4e21-9765-adb76d731ad0 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=84736) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:49:56.954728 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG oslo_concurrency.lockutils [None req-aaa1227b-c5b6-4e21-9765-adb76d731ad0 admin admin] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=84736) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:49:56.955193 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: DEBUG oslo_concurrency.lockutils [None req-aaa1227b-c5b6-4e21-9765-adb76d731ad0 admin admin] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=84736) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:49:56.982833 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: INFO nova.api.openstack.requestlog [None req-aaa1227b-c5b6-4e21-9765-adb76d731ad0 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.086149 Apr 15 19:49:56.983420 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: [pid: 84736|app: 0|req: 35/69] 10.222.0.58 () {60 vars in 1184 bytes} [Thu Apr 15 19:49:56 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:50:54.413321 dv-cinder-786384-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Apr 15 19:50:54.413881 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: Thu Apr 15 19:50:54 2021 - graceful shutdown triggered... Apr 15 19:50:54.414417 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: Gracefully killing worker 1 (pid: 84736)... Apr 15 19:50:54.414568 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: Gracefully killing worker 2 (pid: 84737)... Apr 15 19:50:55.414862 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: worker 1 buried after 1 seconds Apr 15 19:50:55.414862 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: worker 2 buried after 1 seconds Apr 15 19:50:55.414862 dv-cinder-786384-2-iscsi devstack@n-api.service[84735]: goodbye to uWSGI. Apr 15 19:50:55.416621 dv-cinder-786384-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Apr 15 19:50:55.418311 dv-cinder-786384-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 15 19:50:55.428159 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 15 19:50:55.430109 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: *** Starting uWSGI 2.0.15-debian (64bit) on [Thu Apr 15 19:50:55 2021] *** Apr 15 19:50:55.430109 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Apr 15 19:50:55.430109 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Apr 15 19:50:55.430109 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: nodename: dv-cinder-786384-2-iscsi Apr 15 19:50:55.430109 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: machine: x86_64 Apr 15 19:50:55.430109 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: clock source: unix Apr 15 19:50:55.430109 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: pcre jit disabled Apr 15 19:50:55.430109 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: detected number of CPU cores: 4 Apr 15 19:50:55.430109 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: current working directory: / Apr 15 19:50:55.430109 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: detected binary path: /usr/bin/uwsgi-core Apr 15 19:50:55.430109 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: dropping root privileges as early as possible Apr 15 19:50:55.431105 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: your processes number limit is 47843 Apr 15 19:50:55.431105 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: your memory page size is 4096 bytes Apr 15 19:50:55.431105 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: detected max file descriptor number: 2048 Apr 15 19:50:55.431105 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: lock engine: pthread robust mutexes Apr 15 19:50:55.431105 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: thunder lock: enabled Apr 15 19:50:55.431105 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 15 19:50:55.431105 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: dropping root privileges after socket binding Apr 15 19:50:55.431105 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: Python version: 3.6.9 (default, Jan 26 2021, 15:33:00) [GCC 8.4.0] Apr 15 19:50:55.475383 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: Python main interpreter initialized at 0x5576083009c0 Apr 15 19:50:55.475383 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: dropping root privileges after plugin initialization Apr 15 19:50:55.475383 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: python threads support enabled Apr 15 19:50:55.475383 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: your server socket listen backlog is limited to 100 connections Apr 15 19:50:55.475383 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: your mercy for graceful operations on workers is 90 seconds Apr 15 19:50:55.475908 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: mapped 402621 bytes (393 KB) for 2 cores Apr 15 19:50:55.475908 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: *** Operational MODE: preforking *** Apr 15 19:50:55.476093 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: dropping root privileges after application loading Apr 15 19:50:55.476093 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: *** uWSGI is running in multiple interpreter mode *** Apr 15 19:50:55.476093 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: spawned uWSGI master process (pid: 99509) Apr 15 19:50:55.476181 dv-cinder-786384-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 15 19:50:55.476468 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: spawned uWSGI worker 1 (pid: 99511, cores: 1) Apr 15 19:50:55.476826 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: spawned uWSGI worker 2 (pid: 99512, cores: 1) Apr 15 19:50:55.476935 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 15 19:51:00.659953 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 15 19:51:00.661368 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 15 19:51:00.661468 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 15 19:51:00.661552 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 15 19:51:00.661850 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 15 19:51:00.662044 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 15 19:51:00.662247 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 15 19:51:00.662477 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 15 19:51:00.662591 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 15 19:51:00.662778 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 15 19:51:00.662949 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.663250 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.663373 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.663652 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.663763 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.664021 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.664123 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.664379 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.664487 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.664724 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.664824 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.665088 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.665197 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.665446 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.665552 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.665810 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.665915 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.666100 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.666205 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.666457 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.666568 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.666813 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.666914 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-786384-2-iscsi {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.667179 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.667311 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-786384-2-iscsi {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.667555 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.667669 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.667907 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.668014 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.668262 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.668366 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.668605 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.668718 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.668954 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.669062 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.669302 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.669402 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.669655 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.670182 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.670531 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.670690 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.670844 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.670988 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.671203 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.671396 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.671604 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.671762 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.671953 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.672113 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.672268 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.672414 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.672642 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.672802 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.672974 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.673128 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.673334 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.673504 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.673655 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.673835 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.674019 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-786384-2-iscsi {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.674187 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.674379 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.674540 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-786384-2-iscsi {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.674788 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.674982 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.675131 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.675358 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.675540 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.675701 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.676181 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.676343 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.676494 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.676647 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.676797 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.676941 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.677099 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.677255 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.677409 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.677559 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.677708 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.677857 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.678024 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.678170 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.678319 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.678469 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.678642 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.678802 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.678953 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.679097 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.679241 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.679408 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.679638 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.679805 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.679958 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.680111 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.680261 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.680404 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.680552 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.680706 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.680858 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.681001 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.681150 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.681294 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.681491 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.681653 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.681859 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.682026 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.682230 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.682393 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.682548 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.682709 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.682857 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.683007 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.683158 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.683326 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.683487 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.683640 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.683799 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.683950 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.684099 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.684251 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.684440 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.684593 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.684786 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.685031 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.685188 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.685340 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.685491 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.685641 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.685800 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.685966 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.686482 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.686645 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.686798 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.686948 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.687099 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.687248 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.687438 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.687585 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.687728 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.687871 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.688018 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.688172 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.688172 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.688513 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.688513 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.688786 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.688937 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.689085 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.689237 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.689387 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.689529 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.689688 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.689907 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.690055 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.690226 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.690372 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.690514 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.690655 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.690798 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.690948 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.691676 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.691822 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.692022 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.692182 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.692390 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.692554 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.692762 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.692923 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.693108 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.693260 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.693409 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.693626 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.693778 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.693921 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.694064 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.694212 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.694367 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.694523 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.694668 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.694816 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.694975 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.695219 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.695397 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.695558 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.695704 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.695846 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.695995 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.696148 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.696707 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.696867 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.697019 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.697172 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.697316 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.697479 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.697640 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.697784 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.697927 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.698075 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.698235 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.698384 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.698540 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.698685 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.698836 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.698987 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.699139 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.699303 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.699472 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.699624 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.700056 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.700210 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.700361 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.700512 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.700665 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.700816 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.700966 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.701120 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.701264 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.701423 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.701568 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.701725 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.701874 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.702018 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.702167 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.702318 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.702468 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.702618 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.702774 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.702922 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.703066 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.703220 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.703456 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.703618 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.703769 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.703919 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.704063 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.704217 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.704360 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.704509 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.704652 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.704801 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.704946 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.705100 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.705339 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.705495 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.705660 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.705805 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.705961 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.706105 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.706247 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.706406 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.707608 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.707763 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.707915 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.708068 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.708219 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.708370 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.708524 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.708678 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.708833 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.708976 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.709125 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.709275 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.709425 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.709568 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.709722 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.709866 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.710013 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.710255 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.710410 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.710592 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.710761 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.710915 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.711064 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.711210 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 15 19:51:00.711378 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.711533 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.711683 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.711833 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.711982 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.712130 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.712275 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.712426 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.712570 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.712731 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.712889 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.713043 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.713198 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.713342 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.713492 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.713642 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.713792 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.713959 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.714218 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.714388 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.714542 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.714695 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.714844 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.714997 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.715148 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.715443 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.715608 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.715754 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.715896 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.716046 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.716202 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.716347 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.716500 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.716942 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.717121 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.717121 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.717479 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.717735 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.717892 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.717892 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.718173 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.718331 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.718483 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.718483 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.718771 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.718771 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.719055 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.719208 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.719376 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.719532 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.719682 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.719682 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.719962 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.720273 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.720496 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.720652 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.720798 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.720948 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.721099 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.721259 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.721403 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.721546 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.721690 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.721840 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.721992 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.722136 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.722280 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.722429 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.722579 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.722734 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.722885 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.723038 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.723192 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.723359 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.723505 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.723661 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.723807 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.723949 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.724092 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.724297 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.724450 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.724648 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.724802 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.724992 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.725150 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.725352 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.725599 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.725758 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.725905 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.726055 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.726206 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.726399 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.726563 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.726733 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.727154 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.727154 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.727532 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.727676 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.727939 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.728091 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.728240 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.728389 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.728537 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.728691 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.728847 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.728998 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.729159 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.729309 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.729464 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.729613 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.729769 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.729935 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.730085 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.730233 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.730381 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.730617 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.730780 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.730930 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.731086 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.731236 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.731409 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.731577 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.731734 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.731899 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.732056 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.732211 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.732361 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.732521 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.732678 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.732834 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.732998 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.733148 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.733303 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.733463 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.733620 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.733769 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.733935 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.734092 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.734248 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.734411 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.734568 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.734716 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.734871 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.735020 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.735180 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.735352 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.735515 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.735758 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.735920 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.736085 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.736243 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.736404 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.736560 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.736715 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.736864 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.737291 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.737461 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.737612 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.737768 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.737934 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.738171 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.738332 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.738501 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.738658 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.738813 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.738970 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.739126 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.739325 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.739494 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.739644 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.739799 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.739953 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.740109 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.740270 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.740420 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.740598 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.740824 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.740977 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.741127 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.741287 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.741436 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.741592 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.741748 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.741903 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.742052 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.742207 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.742357 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.742505 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.742663 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.742811 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.742975 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.743136 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.743136 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.743454 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.743612 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.743763 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.743910 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.744070 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.744220 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.744368 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.744522 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.744680 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.744841 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.744990 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.745144 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.745301 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.745456 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.745611 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.745784 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.746007 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.746160 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.746309 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.746456 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.746620 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.746838 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.746989 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.747476 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.747634 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.747794 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.747944 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.748101 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.748352 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.748515 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.748673 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.748828 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.748978 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.749161 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.749405 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.749573 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.749725 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.749872 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.750033 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.750190 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.750345 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.750500 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.750649 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.750814 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.751051 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.751215 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.751404 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.751555 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.751703 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.751851 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.752010 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.752161 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.752309 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.752463 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.752613 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.752766 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.752931 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.753083 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.753237 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.753404 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.754043 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.754203 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.754362 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.754512 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.754667 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.754822 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.754977 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.755134 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.755310 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.755466 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.755615 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.755773 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.756062 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.756374 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.756946 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.757368 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.757696 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.758038 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.758432 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.758734 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.759103 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.759513 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.759878 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.760235 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.760591 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.760965 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.761325 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.761677 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.762012 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.762368 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.762723 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.763078 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.767298 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.767298 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.767723 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.767897 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.768071 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.768227 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.768401 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.768575 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.768737 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.768890 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.769052 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.769286 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.769449 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.769449 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.769736 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.769736 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.770038 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.770188 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.770355 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.770517 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.770675 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.770832 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.770832 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.770832 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.770832 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.770832 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.770832 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.770832 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.770832 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.771997 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.771997 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.771997 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.771997 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.771997 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.771997 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.772852 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.772852 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.772852 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.774789 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.774789 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.774789 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.775245 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.775939 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.775939 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.775939 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.776401 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.776552 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.776701 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.776849 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.776849 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.777143 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.777293 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.777448 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.777598 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.777746 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.777915 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.778072 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.778229 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.778380 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.778529 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.778677 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.778837 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.778987 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.779135 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.779396 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.779563 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.779804 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.779959 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.780125 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.780281 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.780432 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.780586 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.780741 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.780892 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.780892 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.781174 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.781322 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.781322 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.781624 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.781774 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.781921 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.782078 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.782227 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.782373 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.782529 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.782685 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.782834 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.782982 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.783136 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.783864 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.784034 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.784193 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.784343 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.784501 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.784651 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.785335 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.785503 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.785664 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.785813 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.785960 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.786108 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.786270 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.786423 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.786571 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.786720 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.786868 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.787024 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.787186 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.787385 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.787546 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.787697 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.787845 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.787992 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.788211 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.788363 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.788511 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.788665 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.788815 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.788971 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.789129 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.789278 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.789434 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.789582 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.789739 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.789994 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.790150 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.790299 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.790448 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.790595 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.790750 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.790908 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.791065 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.791230 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.791427 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.791585 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.791735 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.791893 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.792050 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.792050 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.792332 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.792486 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.792641 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.792802 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.792952 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.793107 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.793271 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.793429 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.794025 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.794186 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.794341 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.794503 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.794654 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.795068 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.795231 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.795441 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.795592 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.795741 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.795910 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.796068 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.796483 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.796647 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.796797 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.796951 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.797101 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.797249 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.797405 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.797555 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.797703 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.797858 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.798014 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.798185 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.798335 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.798490 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.798639 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.798786 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.798941 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.799098 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.799256 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.799439 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.799589 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.799744 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.799899 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.800154 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.800320 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.801017 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.801179 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.801331 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.801485 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.801647 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.801796 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.801951 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.802107 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.802263 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.802413 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.802575 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.802724 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.802888 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.803046 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.803196 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.803422 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.803575 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.804182 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.804346 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.804498 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.804647 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.804807 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.804964 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.805119 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.805268 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.805426 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.805576 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.805732 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.805888 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.806043 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.806198 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.806356 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.806510 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.806672 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.806827 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.806983 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.807139 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.807314 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.807501 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.807654 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.807802 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.807951 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.808099 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.808246 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.808400 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.808549 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.808705 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.808860 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.809014 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.809162 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.809321 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.809485 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.809635 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.809790 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.809945 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.810101 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.810351 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.810507 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.810663 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.810818 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.810973 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.811122 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.811298 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.811462 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.811629 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.811779 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.811935 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.812096 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.812246 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.812401 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.812548 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.812696 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.812850 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.813017 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.813168 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.813315 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.813471 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.813625 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.813774 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.814448 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.814610 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.814760 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.814915 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.815065 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.815212 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.815474 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.815634 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.815784 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.815931 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.816132 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.816298 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.816460 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.816617 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.816766 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.816920 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.817070 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.817224 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.817380 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.817529 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.817683 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.817838 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.817986 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.818151 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.818302 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.818449 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.818603 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.818758 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.818908 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.819066 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.819223 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.819396 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.819555 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.819555 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.819839 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.820040 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.820201 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.820371 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.820604 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.820759 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.820915 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.821071 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.821227 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.821375 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.821523 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.821670 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.821828 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.821977 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.822125 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.822282 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.822430 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.822578 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.822733 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.822884 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.823037 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.823186 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.823357 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.823508 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.823671 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.823827 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.823976 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.824569 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.824729 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.824891 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.825040 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.825195 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.825344 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.825492 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.825640 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.825799 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.825948 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.826096 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.826255 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.826413 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.826573 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.826729 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.826878 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.826878 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.827160 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.827326 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.827488 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.827651 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.827808 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.827959 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.828114 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.828269 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.828424 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.828590 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.828746 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.828894 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.829042 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.829190 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.829349 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.829505 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.829655 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.829802 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.830036 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.830193 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.830355 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.830505 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.830752 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.830752 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.831059 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.831215 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.831451 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.831451 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.831772 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.831929 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.832078 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.832232 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.832394 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.832543 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.832697 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.832856 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.833005 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.833161 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.833359 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.833525 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.833733 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.834058 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.834460 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.835107 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.836366 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.836515 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.836515 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.836679 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.836755 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.836842 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.836917 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.836995 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.837074 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.837147 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.837625 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.837739 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.837817 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.837901 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.837981 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.838254 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.838356 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.838548 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.838642 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.838871 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.838972 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.839244 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.839380 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.839634 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.839733 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.839998 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.840163 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.840361 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.840532 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.840727 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.840827 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.841201 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.841307 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.841558 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.841666 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.841902 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.842001 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.842250 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.842349 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.842604 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.842715 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.842954 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.843053 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.843312 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.843424 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.843704 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.843812 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.844054 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.844153 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.844410 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.844717 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.844825 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.845088 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.845259 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.845423 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.845591 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.845746 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.845977 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.846083 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.846359 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.846476 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.846746 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.846855 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.847102 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.847208 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.848026 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.848142 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.848393 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.848500 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.848744 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.848851 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.849106 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.849214 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.849451 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.849615 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.849895 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.849994 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.850245 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.850357 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.850596 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.850695 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.850994 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.851157 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.851386 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.851558 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.851754 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.851919 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.852137 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.852296 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.852496 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.852666 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.852818 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.853158 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.853331 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.853544 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.853713 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.853865 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.854015 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.854231 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.854396 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.854609 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.854842 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.855000 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.855329 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.855504 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.855656 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.855821 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.855986 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.856143 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.856299 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.856455 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.856611 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.856791 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.857027 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.857185 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.857342 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.857492 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.857648 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.857814 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.857973 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.858129 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.858282 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.858516 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.858681 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.858884 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.859051 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.859249 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.859428 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.859619 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.859777 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.859938 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.860104 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.860255 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.860410 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.860660 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.860830 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.860990 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.861224 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.861383 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.861601 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.861760 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.861978 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.862139 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.862383 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.862550 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.862809 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.863678 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.863852 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.864052 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.864219 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.864420 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.864577 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.864823 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.865139 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.865304 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.865513 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.865688 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.865841 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.866001 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.866205 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.866365 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.866555 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.866719 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.866915 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.867169 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.867377 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.867533 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.867683 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.867843 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.867993 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.868242 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.868402 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.868621 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.868786 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.868980 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.869329 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.869490 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.869679 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.869844 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.870045 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.870203 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.870370 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.870528 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.870737 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.870895 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.871091 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.871257 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.871517 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.871677 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.871872 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.872031 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.872249 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.872407 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.872623 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.872782 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.872976 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.873135 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.873336 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.873501 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.873691 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.873848 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.874042 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.874200 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.874402 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.874637 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.874891 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.875059 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.875608 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.875796 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.875981 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.876140 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.876297 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.876455 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.876610 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.876767 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.876926 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.877077 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.877313 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.877481 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.877632 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.877781 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.877940 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.878090 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.878311 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.878470 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.878693 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.878853 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.879016 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.879178 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.879394 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.879554 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.879724 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.879890 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.880106 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.880271 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.880466 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.880631 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.880820 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.880986 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.881139 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.881295 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.881499 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.881664 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.881870 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.882037 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.882276 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.882442 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.882603 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.883329 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.883492 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.883670 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.883780 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.883958 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.884133 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.884500 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.884866 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.885249 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.885600 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.886144 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.886406 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.886538 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.886933 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.887109 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.887329 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.887513 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.887679 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.887840 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.888018 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.888215 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.888377 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.888584 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.888732 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.888951 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.889097 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.889324 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.889435 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.889688 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.890050 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.890153 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.890405 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.890515 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.890772 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.890882 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.891133 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.891245 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.891577 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.891894 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.892029 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.892261 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.892369 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.892613 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.892716 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.892961 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.893072 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.893314 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.893425 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.893663 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.893783 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.894024 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.894207 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.894413 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.894515 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.894760 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.894924 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.895107 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.895211 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.895515 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.895866 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.896214 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.896371 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.896567 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.896894 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.897049 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.897261 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.897368 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.897609 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.897727 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.897960 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.898090 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.898309 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.898411 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.898665 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.898778 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.899014 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.899122 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.899390 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.899535 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.899719 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.899845 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.900068 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.900189 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.900430 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.900535 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.900781 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.900905 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.901125 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.901254 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.901519 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.901646 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.901804 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.902151 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.902426 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.902576 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.902795 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.902913 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.903159 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.903290 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.903548 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.903913 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.904067 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.904314 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.904445 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.904676 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.904790 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.905035 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.905220 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.905404 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.905654 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.905827 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.905979 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.906135 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.906292 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.906457 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.906609 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.906762 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.906926 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.907256 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.907634 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.907795 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.908026 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.908234 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.908358 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.908479 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.908707 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.908838 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.909122 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.909247 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.909471 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.909600 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.910381 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.910522 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.910685 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.910808 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.911052 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.911182 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.911435 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.911591 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.911786 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.911904 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.912120 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.912253 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.912472 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.912595 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.912826 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.912955 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.913177 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.913311 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.913526 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.913649 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.913875 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.914009 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.914323 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.914459 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.914677 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.914810 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.915147 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.915326 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.915447 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.915569 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.915873 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.916011 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.916138 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.916252 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.916485 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.916705 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.916836 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.917071 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.917206 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.917575 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.917717 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.917839 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.917954 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.918119 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.918269 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.918458 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.918585 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.918825 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.918948 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.919173 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.919311 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.919581 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.920196 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.920417 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.920552 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.920776 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.920901 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.921146 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.921262 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.921511 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.921621 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.921866 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.921984 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.922246 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.922350 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.922627 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.922732 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.922998 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.923112 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.923375 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.923572 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.923755 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.923932 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.924101 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.924254 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.924422 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.924582 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.924739 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.924901 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.925104 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.925348 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.925578 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.925746 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.925942 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.926100 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.926213 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.926313 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.926560 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.926782 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.926921 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.927146 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.927258 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.927533 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.929412 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.929576 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.929708 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.929842 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.929959 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.930072 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.930185 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.930306 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.930427 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.930549 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.930670 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.930790 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.930909 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.931030 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.931151 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.931266 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.931437 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.931559 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.931673 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.931829 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.932098 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.932235 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.932349 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.932458 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.932568 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.932668 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.932774 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.932874 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.932980 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.933081 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.933185 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.933293 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.933393 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.933665 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.933770 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.934018 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.934129 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.934390 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.934503 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.934744 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.934851 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.935115 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.935218 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.935500 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.935947 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.936226 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.936342 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.936705 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=99511) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 15 19:51:00.937938 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.938333 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.938737 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.939108 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.939526 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.940282 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.940282 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.940575 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.940936 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.941846 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.942231 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.942588 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.942971 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.943367 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.943741 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.944107 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.944467 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.944851 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.945215 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.945560 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.945914 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.946300 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.946609 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.946970 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.947397 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.948460 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.948460 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.948460 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.948866 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.949160 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.949555 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.950260 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 15 19:51:00.950547 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=99512) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 15 19:51:00.979485 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_db.sqlalchemy.engines [None req-4fb3f2b9-3935-4919-b8f4-c47288c86608 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=99511) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 15 19:51:00.989057 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_db.sqlalchemy.engines [None req-823b6eb2-692c-4a41-8655-bc6191b796a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=99512) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 15 19:51:01.240729 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.context [None req-4fb3f2b9-3935-4919-b8f4-c47288c86608 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8e59ab27-c8e0-4643-bc4c-06d479de8174(cell1) {{(pid=99511) load_cells /opt/stack/nova/nova/context.py:466}} Apr 15 19:51:01.246543 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4fb3f2b9-3935-4919-b8f4-c47288c86608 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:51:01.248954 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4fb3f2b9-3935-4919-b8f4-c47288c86608 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:51:01.249890 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4fb3f2b9-3935-4919-b8f4-c47288c86608 None None] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:51:01.251847 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.context [None req-823b6eb2-692c-4a41-8655-bc6191b796a0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8e59ab27-c8e0-4643-bc4c-06d479de8174(cell1) {{(pid=99512) load_cells /opt/stack/nova/nova/context.py:466}} Apr 15 19:51:01.252253 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4fb3f2b9-3935-4919-b8f4-c47288c86608 None None] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:51:01.257687 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-823b6eb2-692c-4a41-8655-bc6191b796a0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:51:01.259543 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-823b6eb2-692c-4a41-8655-bc6191b796a0 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:51:01.260638 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-823b6eb2-692c-4a41-8655-bc6191b796a0 None None] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:51:01.262885 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-823b6eb2-692c-4a41-8655-bc6191b796a0 None None] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:51:01.282509 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_db.sqlalchemy.engines [None req-4fb3f2b9-3935-4919-b8f4-c47288c86608 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=99511) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 15 19:51:01.286241 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_db.sqlalchemy.engines [None req-4fb3f2b9-3935-4919-b8f4-c47288c86608 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=99511) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 15 19:51:01.291005 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_db.sqlalchemy.engines [None req-823b6eb2-692c-4a41-8655-bc6191b796a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=99512) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 15 19:51:01.291950 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_db.sqlalchemy.engines [None req-823b6eb2-692c-4a41-8655-bc6191b796a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=99512) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 15 19:51:01.323737 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_db.sqlalchemy.engines [None req-4fb3f2b9-3935-4919-b8f4-c47288c86608 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=99511) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 15 19:51:01.329611 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_db.sqlalchemy.engines [None req-823b6eb2-692c-4a41-8655-bc6191b796a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=99512) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 15 19:51:01.407303 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 15 19:51:01.407303 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: from cryptography.utils import int_from_bytes Apr 15 19:51:01.407650 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 15 19:51:01.407650 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: from cryptography.utils import int_from_bytes Apr 15 19:51:01.413746 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 15 19:51:01.413746 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: from cryptography.utils import int_from_bytes Apr 15 19:51:01.414128 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 15 19:51:01.414128 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: from cryptography.utils import int_from_bytes Apr 15 19:51:01.485730 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO keyring.backend [None req-4fb3f2b9-3935-4919-b8f4-c47288c86608 None None] Loading Gnome Apr 15 19:51:01.491676 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO keyring.backend [None req-823b6eb2-692c-4a41-8655-bc6191b796a0 None None] Loading Gnome Apr 15 19:51:01.506864 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO keyring.backend [None req-4fb3f2b9-3935-4919-b8f4-c47288c86608 None None] Loading Google Apr 15 19:51:01.510254 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO keyring.backend [None req-4fb3f2b9-3935-4919-b8f4-c47288c86608 None None] Loading Windows (alt) Apr 15 19:51:01.512129 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO keyring.backend [None req-823b6eb2-692c-4a41-8655-bc6191b796a0 None None] Loading Google Apr 15 19:51:01.515044 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO keyring.backend [None req-4fb3f2b9-3935-4919-b8f4-c47288c86608 None None] Loading file Apr 15 19:51:01.515549 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO keyring.backend [None req-823b6eb2-692c-4a41-8655-bc6191b796a0 None None] Loading Windows (alt) Apr 15 19:51:01.516169 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO keyring.backend [None req-4fb3f2b9-3935-4919-b8f4-c47288c86608 None None] Loading keyczar Apr 15 19:51:01.516632 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO keyring.backend [None req-4fb3f2b9-3935-4919-b8f4-c47288c86608 None None] Loading multi Apr 15 19:51:01.517504 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO keyring.backend [None req-4fb3f2b9-3935-4919-b8f4-c47288c86608 None None] Loading pyfs Apr 15 19:51:01.520405 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO keyring.backend [None req-823b6eb2-692c-4a41-8655-bc6191b796a0 None None] Loading file Apr 15 19:51:01.521506 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO keyring.backend [None req-823b6eb2-692c-4a41-8655-bc6191b796a0 None None] Loading keyczar Apr 15 19:51:01.521976 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO keyring.backend [None req-823b6eb2-692c-4a41-8655-bc6191b796a0 None None] Loading multi Apr 15 19:51:01.522850 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO keyring.backend [None req-823b6eb2-692c-4a41-8655-bc6191b796a0 None None] Loading pyfs Apr 15 19:51:01.799019 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: WARNING keystonemiddleware.auth_token [None req-4fb3f2b9-3935-4919-b8f4-c47288c86608 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 15 19:51:01.806127 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: WARNING keystonemiddleware.auth_token [None req-4fb3f2b9-3935-4919-b8f4-c47288c86608 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 15 19:51:01.806455 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: WARNING keystonemiddleware.auth_token [None req-823b6eb2-692c-4a41-8655-bc6191b796a0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 15 19:51:01.813506 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: WARNING keystonemiddleware.auth_token [None req-823b6eb2-692c-4a41-8655-bc6191b796a0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 15 19:51:02.143176 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: WARNING keystonemiddleware.auth_token [None req-4fb3f2b9-3935-4919-b8f4-c47288c86608 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 15 19:51:02.148966 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: WARNING keystonemiddleware.auth_token [None req-4fb3f2b9-3935-4919-b8f4-c47288c86608 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 15 19:51:02.152028 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: WARNING keystonemiddleware.auth_token [None req-823b6eb2-692c-4a41-8655-bc6191b796a0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 15 19:51:02.154589 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5576083009c0 pid: 99511 (default app) Apr 15 19:51:02.157746 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: WARNING keystonemiddleware.auth_token [None req-823b6eb2-692c-4a41-8655-bc6191b796a0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 15 19:51:02.163889 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5576083009c0 pid: 99512 (default app) Apr 15 19:51:39.335552 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-dd06e503-ff6f-4cda-879c-f3716fbc1ed9 tempest-VolumesNegativeTest-1926380983 tempest-VolumesNegativeTest-1926380983-project] Action: 'create', calling method: .version_select at 0x7f18d8d342f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-66902978", "metadata": {"Type": "work"}}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:51:39.339078 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-dd06e503-ff6f-4cda-879c-f3716fbc1ed9 tempest-VolumesNegativeTest-1926380983 tempest-VolumesNegativeTest-1926380983-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=99511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 19:51:39.340933 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-dd06e503-ff6f-4cda-879c-f3716fbc1ed9 tempest-VolumesNegativeTest-1926380983 tempest-VolumesNegativeTest-1926380983-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.292904 Apr 15 19:51:39.342046 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 1/1] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Apr 15 19:51:38 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1296 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 15 19:51:39.358782 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e23341d5-a7d5-4b1b-8413-91576c51edc6 tempest-VolumesNegativeTest-1926380983 tempest-VolumesNegativeTest-1926380983-project] Action: 'create', calling method: .version_select at 0x7f18d8d34d08>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1369271354", "metadata": {"Type": "work"}}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:51:39.362029 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e23341d5-a7d5-4b1b-8413-91576c51edc6 tempest-VolumesNegativeTest-1926380983 tempest-VolumesNegativeTest-1926380983-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=99511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 19:51:39.365076 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e23341d5-a7d5-4b1b-8413-91576c51edc6 tempest-VolumesNegativeTest-1926380983 tempest-VolumesNegativeTest-1926380983-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010333 Apr 15 19:51:39.366064 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 2/2] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Apr 15 19:51:39 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 15 19:51:39.382437 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-accf8db9-c0ce-49d7-a52e-e1c8010b5921 tempest-VolumesNegativeTest-1926380983 tempest-VolumesNegativeTest-1926380983-project] Action: 'create', calling method: .version_select at 0x7f18d9204c80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1914499837", "metadata": {"Type": "work"}}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:51:39.384826 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-accf8db9-c0ce-49d7-a52e-e1c8010b5921 tempest-VolumesNegativeTest-1926380983 tempest-VolumesNegativeTest-1926380983-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=99511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 19:51:39.388262 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-accf8db9-c0ce-49d7-a52e-e1c8010b5921 tempest-VolumesNegativeTest-1926380983 tempest-VolumesNegativeTest-1926380983-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.014294 Apr 15 19:51:39.390858 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 3/3] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Apr 15 19:51:39 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 15 19:51:39.403325 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f766b4f8-f7d5-4f25-a8f3-18713436d78c tempest-VolumesNegativeTest-1926380983 tempest-VolumesNegativeTest-1926380983-project] Calling method '.version_select at 0x7f18d8d34620>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:51:39.652347 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7ed84b89-a0b9-4cc7-971c-5178011a34d5 tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] Action: 'create', calling method: .version_select at 0x7f18d8d372f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1782320634"}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:51:40.445674 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-f766b4f8-f7d5-4f25-a8f3-18713436d78c tempest-VolumesNegativeTest-1926380983 tempest-VolumesNegativeTest-1926380983-project] HTTP exception thrown: Volume tempest-invalid-2094825300 could not be found. Apr 15 19:51:40.447372 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f766b4f8-f7d5-4f25-a8f3-18713436d78c tempest-VolumesNegativeTest-1926380983 tempest-VolumesNegativeTest-1926380983-project] Returning 404 to user: Volume tempest-invalid-2094825300 could not be found. {{(pid=99511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 19:51:40.448482 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f766b4f8-f7d5-4f25-a8f3-18713436d78c tempest-VolumesNegativeTest-1926380983 tempest-VolumesNegativeTest-1926380983-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2094825300" status: 404 len: 99 microversion: 2.1 time: 1.050020 Apr 15 19:51:40.449269 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 4/4] 10.222.0.58 () {58 vars in 1208 bytes} [Thu Apr 15 19:51:39 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-2094825300 => generated 99 bytes in 1051 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 15 19:51:40.460212 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-730e8c31-8ed2-40b3-b3fa-8a44d5cd57e3 tempest-VolumesNegativeTest-1926380983 tempest-VolumesNegativeTest-1926380983-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005475 Apr 15 19:51:40.461286 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 5/5] 10.222.0.58 () {58 vars in 1130 bytes} [Thu Apr 15 19:51:40 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 15 19:51:40.473178 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-61891f6c-166a-40a8-990c-cf97d086c75c tempest-VolumesNegativeTest-1926380983 tempest-VolumesNegativeTest-1926380983-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004691 Apr 15 19:51:40.478638 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 6/6] 10.222.0.58 () {58 vars in 1127 bytes} [Thu Apr 15 19:51:40 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 15 19:51:40.490510 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-08d1a85e-889f-4e5b-8805-e5a701d686c2 tempest-VolumesNegativeTest-1926380983 tempest-VolumesNegativeTest-1926380983-project] Calling method '.version_select at 0x7f18d8d348c8>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:51:40.799199 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-08d1a85e-889f-4e5b-8805-e5a701d686c2 tempest-VolumesNegativeTest-1926380983 tempest-VolumesNegativeTest-1926380983-project] HTTP exception thrown: Volume f72299c2-44f8-4ae8-82d9-ad7121a57cf0 could not be found. Apr 15 19:51:40.800423 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-08d1a85e-889f-4e5b-8805-e5a701d686c2 tempest-VolumesNegativeTest-1926380983 tempest-VolumesNegativeTest-1926380983-project] Returning 404 to user: Volume f72299c2-44f8-4ae8-82d9-ad7121a57cf0 could not be found. {{(pid=99511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 19:51:40.801289 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-08d1a85e-889f-4e5b-8805-e5a701d686c2 tempest-VolumesNegativeTest-1926380983 tempest-VolumesNegativeTest-1926380983-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/f72299c2-44f8-4ae8-82d9-ad7121a57cf0" status: 404 len: 109 microversion: 2.1 time: 0.315768 Apr 15 19:51:40.801868 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 7/7] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Apr 15 19:51:40 2021] DELETE /compute/v2.1/os-volumes/f72299c2-44f8-4ae8-82d9-ad7121a57cf0 => generated 109 bytes in 317 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 15 19:51:40.813644 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9612222b-9005-4706-bd60-14a5896e1e23 tempest-VolumesNegativeTest-1926380983 tempest-VolumesNegativeTest-1926380983-project] Calling method '.version_select at 0x7f18d8ca20d0>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:51:41.300865 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-9612222b-9005-4706-bd60-14a5896e1e23 tempest-VolumesNegativeTest-1926380983 tempest-VolumesNegativeTest-1926380983-project] HTTP exception thrown: Volume 0a6c543e-3ca2-4fee-b345-82a74c084be8 could not be found. Apr 15 19:51:41.301530 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9612222b-9005-4706-bd60-14a5896e1e23 tempest-VolumesNegativeTest-1926380983 tempest-VolumesNegativeTest-1926380983-project] Returning 404 to user: Volume 0a6c543e-3ca2-4fee-b345-82a74c084be8 could not be found. {{(pid=99511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 19:51:41.302395 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9612222b-9005-4706-bd60-14a5896e1e23 tempest-VolumesNegativeTest-1926380983 tempest-VolumesNegativeTest-1926380983-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/0a6c543e-3ca2-4fee-b345-82a74c084be8" status: 404 len: 109 microversion: 2.1 time: 0.492950 Apr 15 19:51:41.314173 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 8/8] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Apr 15 19:51:40 2021] GET /compute/v2.1/os-volumes/0a6c543e-3ca2-4fee-b345-82a74c084be8 => generated 109 bytes in 494 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 15 19:51:41.325192 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7ed84b89-a0b9-4cc7-971c-5178011a34d5 tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.118450 Apr 15 19:51:41.336788 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 1/9] 10.222.0.58 () {60 vars in 1145 bytes} [Thu Apr 15 19:51:38 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 3134 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Apr 15 19:51:41.339493 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-75854097-d331-4413-9f6d-76d70ec29b2f tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] Calling method '.version_select at 0x7f18d8d34620>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:51:41.577962 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-75854097-d331-4413-9f6d-76d70ec29b2f tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/74a52300-b363-40ca-b7d1-ea111aed1b6b" status: 200 len: 345 microversion: 2.1 time: 0.242537 Apr 15 19:51:41.578888 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 9/10] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Apr 15 19:51:41 2021] GET /compute/v2.1/os-volumes/74a52300-b363-40ca-b7d1-ea111aed1b6b => generated 345 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:51:42.591059 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f89f9db5-2e51-420b-89d7-506cf91ed102 tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] Calling method '.version_select at 0x7f18d8d37b70>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:51:42.869960 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f89f9db5-2e51-420b-89d7-506cf91ed102 tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/74a52300-b363-40ca-b7d1-ea111aed1b6b" status: 200 len: 346 microversion: 2.1 time: 0.283066 Apr 15 19:51:42.871033 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 2/11] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Apr 15 19:51:42 2021] GET /compute/v2.1/os-volumes/74a52300-b363-40ca-b7d1-ea111aed1b6b => generated 346 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:51:42.883050 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-3317f17a-bf90-408a-ac85-00c7605e7e8a tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] Action: 'create', calling method: .version_select at 0x7f18d8ca2268>, body: {"snapshot": {"volume_id": "74a52300-b363-40ca-b7d1-ea111aed1b6b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-696354468"}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:51:43.420777 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-3317f17a-bf90-408a-ac85-00c7605e7e8a tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] 10.222.0.58 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.541608 Apr 15 19:51:43.421702 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 10/12] 10.222.0.58 () {60 vars in 1152 bytes} [Thu Apr 15 19:51:42 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:51:43.432089 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f4a4f07f-ac5c-4ec7-82ae-e962392fe302 tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] Calling method '.version_select at 0x7f18d8cfad08>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:51:43.584333 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f4a4f07f-ac5c-4ec7-82ae-e962392fe302 tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/70c9a3dd-712b-45cb-9e38-352ef4fa341d" status: 200 len: 286 microversion: 2.1 time: 0.156173 Apr 15 19:51:43.585375 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 3/13] 10.222.0.58 () {58 vars in 1241 bytes} [Thu Apr 15 19:51:43 2021] GET /compute/v2.1/os-snapshots/70c9a3dd-712b-45cb-9e38-352ef4fa341d => generated 286 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:51:43.598978 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-46746e0d-8c4a-4864-95d7-4222b1948b26 tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] Calling method '.version_select at 0x7f18d8cfaae8>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:51:43.672684 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7809b653-1622-4e3c-b889-39e4011eb48d tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1617894262", "imageRef": "10d66d6e-f687-4228-93d1-67502c9b42e2", "flavorRef": "452", "networks": [{"uuid": "d2181703-f14f-4fe8-a943-cb5dacbb4abf"}]}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:51:43.692298 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-46746e0d-8c4a-4864-95d7-4222b1948b26 tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.099137 Apr 15 19:51:43.692986 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 4/14] 10.222.0.58 () {58 vars in 1130 bytes} [Thu Apr 15 19:51:43 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:51:43.704897 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6662c1e4-fe6e-4a55-86d8-6066d246fea6 tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] Calling method '.version_select at 0x7f18d8ca00d0>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:51:43.827866 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6662c1e4-fe6e-4a55-86d8-6066d246fea6 tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/70c9a3dd-712b-45cb-9e38-352ef4fa341d" status: 200 len: 286 microversion: 2.1 time: 0.127157 Apr 15 19:51:43.828543 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 5/15] 10.222.0.58 () {58 vars in 1241 bytes} [Thu Apr 15 19:51:43 2021] GET /compute/v2.1/os-snapshots/70c9a3dd-712b-45cb-9e38-352ef4fa341d => generated 286 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:51:43.909055 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.network.neutron [None req-7809b653-1622-4e3c-b889-39e4011eb48d tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] validate_networks() for [('d2181703-f14f-4fe8-a943-cb5dacbb4abf', None, None, None)] {{(pid=99511) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 15 19:51:44.840820 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c4246e46-dcf2-4834-9472-e6531a12fc99 tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] Calling method '.version_select at 0x7f18d8ca0620>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:51:44.928869 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c4246e46-dcf2-4834-9472-e6531a12fc99 tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/70c9a3dd-712b-45cb-9e38-352ef4fa341d" status: 200 len: 286 microversion: 2.1 time: 0.091946 Apr 15 19:51:44.933550 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 6/16] 10.222.0.58 () {58 vars in 1241 bytes} [Thu Apr 15 19:51:44 2021] GET /compute/v2.1/os-snapshots/70c9a3dd-712b-45cb-9e38-352ef4fa341d => generated 286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:51:45.942194 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c72da22d-2b3f-45b4-a906-7ea08a732cae tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] Calling method '.version_select at 0x7f18d8cfaea0>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:51:45.964024 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-7809b653-1622-4e3c-b889-39e4011eb48d tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Flavor limits 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 15 19:51:45.964620 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-7809b653-1622-4e3c-b889-39e4011eb48d tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Image limits 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 15 19:51:45.965275 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-7809b653-1622-4e3c-b889-39e4011eb48d tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Flavor pref 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 15 19:51:45.965837 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-7809b653-1622-4e3c-b889-39e4011eb48d tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Image pref 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 15 19:51:45.966401 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-7809b653-1622-4e3c-b889-39e4011eb48d tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 15 19:51:45.998691 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7809b653-1622-4e3c-b889-39e4011eb48d tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:51:46.001638 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7809b653-1622-4e3c-b889-39e4011eb48d tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:51:46.004579 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7809b653-1622-4e3c-b889-39e4011eb48d tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:51:46.006568 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7809b653-1622-4e3c-b889-39e4011eb48d tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:51:46.076211 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c72da22d-2b3f-45b4-a906-7ea08a732cae tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/70c9a3dd-712b-45cb-9e38-352ef4fa341d" status: 200 len: 286 microversion: 2.1 time: 0.139406 Apr 15 19:51:46.076841 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 7/17] 10.222.0.58 () {58 vars in 1241 bytes} [Thu Apr 15 19:51:45 2021] GET /compute/v2.1/os-snapshots/70c9a3dd-712b-45cb-9e38-352ef4fa341d => generated 286 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 15 19:51:46.084439 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-7809b653-1622-4e3c-b889-39e4011eb48d tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Getting quotas for project 4a86c89f03e548cdb2f0fc7c1af2ea4c. Resources: {'cores', 'instances', 'ram'} {{(pid=99511) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 15 19:51:46.113226 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-7809b653-1622-4e3c-b889-39e4011eb48d tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Getting quotas for user 246785b33b504bebbf6b59e4d8f129fd and project 4a86c89f03e548cdb2f0fc7c1af2ea4c. Resources: {'cores', 'instances', 'ram'} {{(pid=99511) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 15 19:51:46.159959 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7809b653-1622-4e3c-b889-39e4011eb48d tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Going to run 1 instances... {{(pid=99511) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 15 19:51:46.163241 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7809b653-1622-4e3c-b889-39e4011eb48d tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='10d66d6e-f687-4228-93d1-67502c9b42e2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 15 19:51:46.355096 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7809b653-1622-4e3c-b889-39e4011eb48d tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.895330 Apr 15 19:51:46.355836 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 11/18] 10.222.0.58 () {60 vars in 1137 bytes} [Thu Apr 15 19:51:43 2021] POST /compute/v2.1/servers => generated 380 bytes in 2897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 15 19:51:46.372538 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-635fc63a-71dc-4595-80d0-364c931809f3 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:51:46.373523 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-635fc63a-71dc-4595-80d0-364c931809f3 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:51:46.582651 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-635fc63a-71dc-4595-80d0-364c931809f3 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:51:46.606424 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-635fc63a-71dc-4595-80d0-364c931809f3 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1215 microversion: 2.1 time: 0.242027 Apr 15 19:51:46.610520 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 8/19] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:51:46 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1215 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:51:47.090709 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ee67b053-9693-4bcc-8c16-6788e01ce83d tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] Calling method '.version_select at 0x7f18d8b2c7b8>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:51:47.217976 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ee67b053-9693-4bcc-8c16-6788e01ce83d tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/70c9a3dd-712b-45cb-9e38-352ef4fa341d" status: 200 len: 286 microversion: 2.1 time: 0.132281 Apr 15 19:51:47.218603 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 12/20] 10.222.0.58 () {58 vars in 1241 bytes} [Thu Apr 15 19:51:47 2021] GET /compute/v2.1/os-snapshots/70c9a3dd-712b-45cb-9e38-352ef4fa341d => generated 286 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:51:47.627215 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a81a1892-85c1-46f3-8f9a-b4d80c426cd4 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:51:47.627961 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a81a1892-85c1-46f3-8f9a-b4d80c426cd4 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:51:48.134839 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a81a1892-85c1-46f3-8f9a-b4d80c426cd4 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:51:48.148384 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a81a1892-85c1-46f3-8f9a-b4d80c426cd4 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1215 microversion: 2.1 time: 0.525893 Apr 15 19:51:48.154337 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 9/21] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:51:47 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1215 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:51:48.230528 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-8c51564a-61fc-49e9-b030-e885d0974824 tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] Calling method '.version_select at 0x7f18d8b2cf28>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:51:48.376510 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-8c51564a-61fc-49e9-b030-e885d0974824 tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/70c9a3dd-712b-45cb-9e38-352ef4fa341d" status: 200 len: 286 microversion: 2.1 time: 0.150241 Apr 15 19:51:48.378399 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 13/22] 10.222.0.58 () {58 vars in 1241 bytes} [Thu Apr 15 19:51:48 2021] GET /compute/v2.1/os-snapshots/70c9a3dd-712b-45cb-9e38-352ef4fa341d => generated 286 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:51:49.175391 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-49f7deee-2e85-46e8-90b3-b84c463b0095 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:51:49.179118 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-49f7deee-2e85-46e8-90b3-b84c463b0095 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:51:49.197916 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-49f7deee-2e85-46e8-90b3-b84c463b0095 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:51:49.199852 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-49f7deee-2e85-46e8-90b3-b84c463b0095 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:51:49.205787 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-49f7deee-2e85-46e8-90b3-b84c463b0095 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:51:49.206605 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-49f7deee-2e85-46e8-90b3-b84c463b0095 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:51:49.390731 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-75d7f57e-ccd3-40ed-b9d7-736bc5f780b5 tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] Calling method '.version_select at 0x7f18d82c9378>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:51:49.533156 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-75d7f57e-ccd3-40ed-b9d7-736bc5f780b5 tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/70c9a3dd-712b-45cb-9e38-352ef4fa341d" status: 200 len: 287 microversion: 2.1 time: 0.146625 Apr 15 19:51:49.534637 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 14/23] 10.222.0.58 () {58 vars in 1241 bytes} [Thu Apr 15 19:51:49 2021] GET /compute/v2.1/os-snapshots/70c9a3dd-712b-45cb-9e38-352ef4fa341d => generated 287 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:51:49.545908 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-adffc744-a65a-4415-ac69-d1e7a79b9900 tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] Calling method '.version_select at 0x7f18d82c9730>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:51:49.725960 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-adffc744-a65a-4415-ac69-d1e7a79b9900 tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] 10.222.0.58 "DELETE /compute/v2.1/os-snapshots/70c9a3dd-712b-45cb-9e38-352ef4fa341d" status: 202 len: 0 microversion: 2.1 time: 0.184899 Apr 15 19:51:49.727098 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 15/24] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Apr 15 19:51:49 2021] DELETE /compute/v2.1/os-snapshots/70c9a3dd-712b-45cb-9e38-352ef4fa341d => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 15 19:51:49.743544 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-3dfbb6a1-e79a-42ea-89af-e314245fc3ef tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] Calling method '.version_select at 0x7f18d8c7dbf8>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:51:49.833811 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-3dfbb6a1-e79a-42ea-89af-e314245fc3ef tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/70c9a3dd-712b-45cb-9e38-352ef4fa341d" status: 200 len: 286 microversion: 2.1 time: 0.101944 Apr 15 19:51:49.834618 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 16/25] 10.222.0.58 () {58 vars in 1241 bytes} [Thu Apr 15 19:51:49 2021] GET /compute/v2.1/os-snapshots/70c9a3dd-712b-45cb-9e38-352ef4fa341d => generated 286 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:51:50.011023 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-49f7deee-2e85-46e8-90b3-b84c463b0095 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:51:50.029934 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-49f7deee-2e85-46e8-90b3-b84c463b0095 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1211 microversion: 2.1 time: 0.860135 Apr 15 19:51:50.039978 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 10/26] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:51:49 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1211 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:51:50.846798 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-bb57c7a9-d8cd-4c4f-a038-bd3205afee59 tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] Calling method '.version_select at 0x7f18d8b2c9d8>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:51:50.935756 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-bb57c7a9-d8cd-4c4f-a038-bd3205afee59 tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/70c9a3dd-712b-45cb-9e38-352ef4fa341d" status: 200 len: 286 microversion: 2.1 time: 0.093338 Apr 15 19:51:50.936320 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 17/27] 10.222.0.58 () {58 vars in 1241 bytes} [Thu Apr 15 19:51:50 2021] GET /compute/v2.1/os-snapshots/70c9a3dd-712b-45cb-9e38-352ef4fa341d => generated 286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:51:51.050442 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-cc49aafe-9d61-40cd-9937-3c7dd5a9e867 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:51:51.051090 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-cc49aafe-9d61-40cd-9937-3c7dd5a9e867 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:51:51.059347 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cc49aafe-9d61-40cd-9937-3c7dd5a9e867 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:51:51.060043 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cc49aafe-9d61-40cd-9937-3c7dd5a9e867 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:51:51.061076 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cc49aafe-9d61-40cd-9937-3c7dd5a9e867 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:51:51.061773 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cc49aafe-9d61-40cd-9937-3c7dd5a9e867 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:51:51.315972 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-cc49aafe-9d61-40cd-9937-3c7dd5a9e867 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:51:51.336532 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-cc49aafe-9d61-40cd-9937-3c7dd5a9e867 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1211 microversion: 2.1 time: 0.290034 Apr 15 19:51:51.337434 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 11/28] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:51:51 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1211 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:51:51.913825 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-dbe4109e-f043-49e6-9f37-01d85cd76b43 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1110106858", "imageRef": "10d66d6e-f687-4228-93d1-67502c9b42e2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e6ead994-471f-49ea-8876-a7b9c3272bfc"}]}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:51:51.948313 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-23fdead7-9a5c-4af2-922f-701e753a4519 tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] Calling method '.version_select at 0x7f18d8b07ea0>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:51:52.036840 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-23fdead7-9a5c-4af2-922f-701e753a4519 tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/70c9a3dd-712b-45cb-9e38-352ef4fa341d" status: 200 len: 286 microversion: 2.1 time: 0.092426 Apr 15 19:51:52.037707 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 12/29] 10.222.0.58 () {58 vars in 1241 bytes} [Thu Apr 15 19:51:51 2021] GET /compute/v2.1/os-snapshots/70c9a3dd-712b-45cb-9e38-352ef4fa341d => generated 286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:51:52.083093 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.network.neutron [None req-dbe4109e-f043-49e6-9f37-01d85cd76b43 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] validate_networks() for [('e6ead994-471f-49ea-8876-a7b9c3272bfc', None, None, None)] {{(pid=99511) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 15 19:51:52.358683 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a142c5bd-2805-4e3f-bcd6-b0680cf1a1fa tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:51:52.359812 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a142c5bd-2805-4e3f-bcd6-b0680cf1a1fa tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:51:52.370004 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a142c5bd-2805-4e3f-bcd6-b0680cf1a1fa tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:51:52.370839 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a142c5bd-2805-4e3f-bcd6-b0680cf1a1fa tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:51:52.372370 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a142c5bd-2805-4e3f-bcd6-b0680cf1a1fa tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:51:52.373068 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a142c5bd-2805-4e3f-bcd6-b0680cf1a1fa tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:51:52.642749 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a142c5bd-2805-4e3f-bcd6-b0680cf1a1fa tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:51:52.653173 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a142c5bd-2805-4e3f-bcd6-b0680cf1a1fa tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1211 microversion: 2.1 time: 0.301597 Apr 15 19:51:52.664324 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 13/30] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:51:52 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1211 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:51:53.052722 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-8d5e62fd-b5b4-4ecf-a7f8-2aad5e3ac297 tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] Calling method '.version_select at 0x7f18d8b2b510>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:51:53.171490 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-8d5e62fd-b5b4-4ecf-a7f8-2aad5e3ac297 tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/70c9a3dd-712b-45cb-9e38-352ef4fa341d" status: 200 len: 286 microversion: 2.1 time: 0.125607 Apr 15 19:51:53.172116 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 14/31] 10.222.0.58 () {58 vars in 1241 bytes} [Thu Apr 15 19:51:53 2021] GET /compute/v2.1/os-snapshots/70c9a3dd-712b-45cb-9e38-352ef4fa341d => generated 286 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 15 19:51:53.672531 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-fbe2c0e4-308d-4a5c-a520-0230cde94492 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:51:53.673420 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-fbe2c0e4-308d-4a5c-a520-0230cde94492 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:51:53.690484 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fbe2c0e4-308d-4a5c-a520-0230cde94492 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:51:53.691019 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fbe2c0e4-308d-4a5c-a520-0230cde94492 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:51:53.694808 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fbe2c0e4-308d-4a5c-a520-0230cde94492 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:51:53.695409 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fbe2c0e4-308d-4a5c-a520-0230cde94492 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:51:53.868165 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-dbe4109e-f043-49e6-9f37-01d85cd76b43 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Flavor limits 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 15 19:51:53.868653 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-dbe4109e-f043-49e6-9f37-01d85cd76b43 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Image limits 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 15 19:51:53.869341 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-dbe4109e-f043-49e6-9f37-01d85cd76b43 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Flavor pref 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 15 19:51:53.869809 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-dbe4109e-f043-49e6-9f37-01d85cd76b43 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Image pref 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 15 19:51:53.870443 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-dbe4109e-f043-49e6-9f37-01d85cd76b43 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 15 19:51:53.882409 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dbe4109e-f043-49e6-9f37-01d85cd76b43 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:51:53.883155 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dbe4109e-f043-49e6-9f37-01d85cd76b43 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:51:53.884201 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dbe4109e-f043-49e6-9f37-01d85cd76b43 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:51:53.884855 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dbe4109e-f043-49e6-9f37-01d85cd76b43 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:51:53.938333 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-dbe4109e-f043-49e6-9f37-01d85cd76b43 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Getting quotas for project 684b341c4ce449dd86d6a51e0633e5ab. Resources: {'cores', 'instances', 'ram'} {{(pid=99511) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 15 19:51:53.944821 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-dbe4109e-f043-49e6-9f37-01d85cd76b43 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Getting quotas for user 803b65bf7cb54fffab5ad634e9a1baea and project 684b341c4ce449dd86d6a51e0633e5ab. Resources: {'cores', 'instances', 'ram'} {{(pid=99511) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 15 19:51:53.971672 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-dbe4109e-f043-49e6-9f37-01d85cd76b43 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Going to run 1 instances... {{(pid=99511) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 15 19:51:53.978498 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-dbe4109e-f043-49e6-9f37-01d85cd76b43 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='10d66d6e-f687-4228-93d1-67502c9b42e2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 15 19:51:54.044032 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-fbe2c0e4-308d-4a5c-a520-0230cde94492 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:51:54.063174 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-fbe2c0e4-308d-4a5c-a520-0230cde94492 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1267 microversion: 2.1 time: 0.389739 Apr 15 19:51:54.064413 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 15/32] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:51:53 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1267 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:51:54.092602 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-dbe4109e-f043-49e6-9f37-01d85cd76b43 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.343211 Apr 15 19:51:54.093758 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 18/33] 10.222.0.58 () {60 vars in 1137 bytes} [Thu Apr 15 19:51:51 2021] POST /compute/v2.1/servers => generated 383 bytes in 2345 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 15 19:51:54.106295 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9da091d7-67f7-4e56-9662-b36f166be30b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:51:54.107157 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9da091d7-67f7-4e56-9662-b36f166be30b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:51:54.184815 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-94f1a528-6905-4b65-8643-c1886f54250c tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] Calling method '.version_select at 0x7f18d8b2ca60>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:51:54.323640 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-94f1a528-6905-4b65-8643-c1886f54250c tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] HTTP exception thrown: Snapshot 70c9a3dd-712b-45cb-9e38-352ef4fa341d could not be found. Apr 15 19:51:54.324790 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-94f1a528-6905-4b65-8643-c1886f54250c tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] Returning 404 to user: Snapshot 70c9a3dd-712b-45cb-9e38-352ef4fa341d could not be found. {{(pid=99511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 19:51:54.325864 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-94f1a528-6905-4b65-8643-c1886f54250c tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/70c9a3dd-712b-45cb-9e38-352ef4fa341d" status: 404 len: 111 microversion: 2.1 time: 0.145515 Apr 15 19:51:54.327203 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 19/34] 10.222.0.58 () {58 vars in 1241 bytes} [Thu Apr 15 19:51:54 2021] GET /compute/v2.1/os-snapshots/70c9a3dd-712b-45cb-9e38-352ef4fa341d => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 15 19:51:54.335900 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c06b1a3d-de52-4a5e-bb97-c43291e17cc4 tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] Calling method '.version_select at 0x7f18d8c82ea0>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:51:54.485320 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9da091d7-67f7-4e56-9662-b36f166be30b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:51:54.498920 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9da091d7-67f7-4e56-9662-b36f166be30b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1222 microversion: 2.1 time: 0.397196 Apr 15 19:51:54.509096 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 16/35] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:51:54 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1222 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:51:54.755300 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c06b1a3d-de52-4a5e-bb97-c43291e17cc4 tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/74a52300-b363-40ca-b7d1-ea111aed1b6b" status: 202 len: 0 microversion: 2.1 time: 0.423756 Apr 15 19:51:54.759312 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 20/36] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Apr 15 19:51:54 2021] DELETE /compute/v2.1/os-volumes/74a52300-b363-40ca-b7d1-ea111aed1b6b => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 15 19:51:54.764904 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-17525edc-44d7-49c2-b5ca-b428abb95251 tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] Calling method '.version_select at 0x7f18d8b2b2f0>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:51:54.941024 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f1a8136d-b64b-4b9d-9856-bb9fcea3417c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1981322077", "imageRef": "10d66d6e-f687-4228-93d1-67502c9b42e2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e6ead994-471f-49ea-8876-a7b9c3272bfc"}]}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:51:55.027635 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-17525edc-44d7-49c2-b5ca-b428abb95251 tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] HTTP exception thrown: Volume 74a52300-b363-40ca-b7d1-ea111aed1b6b could not be found. Apr 15 19:51:55.028579 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-17525edc-44d7-49c2-b5ca-b428abb95251 tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] Returning 404 to user: Volume 74a52300-b363-40ca-b7d1-ea111aed1b6b could not be found. {{(pid=99512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 19:51:55.029960 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-17525edc-44d7-49c2-b5ca-b428abb95251 tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/74a52300-b363-40ca-b7d1-ea111aed1b6b" status: 404 len: 109 microversion: 2.1 time: 0.269222 Apr 15 19:51:55.030955 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 17/37] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Apr 15 19:51:54 2021] GET /compute/v2.1/os-volumes/74a52300-b363-40ca-b7d1-ea111aed1b6b => generated 109 bytes in 271 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 15 19:51:55.051750 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-39089a94-3045-476d-a4e3-f5924d7fa46e tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] Calling method '.version_select at 0x7f18d8ac0b70>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:51:55.137399 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.network.neutron [None req-f1a8136d-b64b-4b9d-9856-bb9fcea3417c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] validate_networks() for [('e6ead994-471f-49ea-8876-a7b9c3272bfc', None, None, None)] {{(pid=99511) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 15 19:51:55.263789 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-39089a94-3045-476d-a4e3-f5924d7fa46e tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] HTTP exception thrown: Volume 74a52300-b363-40ca-b7d1-ea111aed1b6b could not be found. Apr 15 19:51:55.264482 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-39089a94-3045-476d-a4e3-f5924d7fa46e tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] Returning 404 to user: Volume 74a52300-b363-40ca-b7d1-ea111aed1b6b could not be found. {{(pid=99512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 19:51:55.265224 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-39089a94-3045-476d-a4e3-f5924d7fa46e tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/74a52300-b363-40ca-b7d1-ea111aed1b6b" status: 404 len: 109 microversion: 2.1 time: 0.220970 Apr 15 19:51:55.266097 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 18/38] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Apr 15 19:51:55 2021] DELETE /compute/v2.1/os-volumes/74a52300-b363-40ca-b7d1-ea111aed1b6b => generated 109 bytes in 223 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 15 19:51:55.271844 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-cc7553a5-fa34-4a34-afe0-0818765319f2 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:51:55.272510 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-cc7553a5-fa34-4a34-afe0-0818765319f2 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:51:55.305246 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cc7553a5-fa34-4a34-afe0-0818765319f2 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:51:55.305854 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cc7553a5-fa34-4a34-afe0-0818765319f2 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:51:55.306781 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cc7553a5-fa34-4a34-afe0-0818765319f2 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:51:55.311884 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cc7553a5-fa34-4a34-afe0-0818765319f2 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:51:57.570328 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-cc7553a5-fa34-4a34-afe0-0818765319f2 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:51:57.584818 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-cc7553a5-fa34-4a34-afe0-0818765319f2 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1315 microversion: 2.1 time: 2.317588 Apr 15 19:51:57.593580 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 19/39] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:51:55 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1315 bytes in 2327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:51:57.604753 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-8c93e32c-a284-4199-836c-ff5a44c81754 tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] Calling method '.version_select at 0x7f18d8c58bf8>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:51:57.948363 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-8c93e32c-a284-4199-836c-ff5a44c81754 tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] HTTP exception thrown: Volume 74a52300-b363-40ca-b7d1-ea111aed1b6b could not be found. Apr 15 19:51:57.949000 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-8c93e32c-a284-4199-836c-ff5a44c81754 tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] Returning 404 to user: Volume 74a52300-b363-40ca-b7d1-ea111aed1b6b could not be found. {{(pid=99512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 19:51:57.950037 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-8c93e32c-a284-4199-836c-ff5a44c81754 tempest-VolumesSnapshotsTestJSON-1090862268 tempest-VolumesSnapshotsTestJSON-1090862268-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/74a52300-b363-40ca-b7d1-ea111aed1b6b" status: 404 len: 109 microversion: 2.1 time: 0.355186 Apr 15 19:51:57.951259 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 20/40] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Apr 15 19:51:57 2021] GET /compute/v2.1/os-volumes/74a52300-b363-40ca-b7d1-ea111aed1b6b => generated 109 bytes in 357 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 15 19:51:58.606663 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a1edf5e2-795c-4456-991c-ce83886d547b tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:51:58.607352 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a1edf5e2-795c-4456-991c-ce83886d547b tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:51:58.647877 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a1edf5e2-795c-4456-991c-ce83886d547b tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:51:58.648410 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a1edf5e2-795c-4456-991c-ce83886d547b tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:51:58.649326 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a1edf5e2-795c-4456-991c-ce83886d547b tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:51:58.649902 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a1edf5e2-795c-4456-991c-ce83886d547b tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:51:58.768622 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-f1a8136d-b64b-4b9d-9856-bb9fcea3417c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Flavor limits 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 15 19:51:58.769097 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-f1a8136d-b64b-4b9d-9856-bb9fcea3417c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Image limits 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 15 19:51:58.769649 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-f1a8136d-b64b-4b9d-9856-bb9fcea3417c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Flavor pref 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 15 19:51:58.770108 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-f1a8136d-b64b-4b9d-9856-bb9fcea3417c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Image pref 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 15 19:51:58.770566 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-f1a8136d-b64b-4b9d-9856-bb9fcea3417c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 15 19:51:58.790813 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f1a8136d-b64b-4b9d-9856-bb9fcea3417c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:51:58.800978 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f1a8136d-b64b-4b9d-9856-bb9fcea3417c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:51:58.801964 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f1a8136d-b64b-4b9d-9856-bb9fcea3417c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:51:58.802461 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f1a8136d-b64b-4b9d-9856-bb9fcea3417c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:51:58.910165 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-f1a8136d-b64b-4b9d-9856-bb9fcea3417c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Getting quotas for project 684b341c4ce449dd86d6a51e0633e5ab. Resources: {'cores', 'instances', 'ram'} {{(pid=99511) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 15 19:51:58.930818 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-f1a8136d-b64b-4b9d-9856-bb9fcea3417c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Getting quotas for user 803b65bf7cb54fffab5ad634e9a1baea and project 684b341c4ce449dd86d6a51e0633e5ab. Resources: {'cores', 'instances', 'ram'} {{(pid=99511) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 15 19:51:59.020584 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f1a8136d-b64b-4b9d-9856-bb9fcea3417c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Going to run 1 instances... {{(pid=99511) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 15 19:51:59.023081 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f1a8136d-b64b-4b9d-9856-bb9fcea3417c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='10d66d6e-f687-4228-93d1-67502c9b42e2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 15 19:51:59.249429 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f1a8136d-b64b-4b9d-9856-bb9fcea3417c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.312626 Apr 15 19:51:59.250043 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 21/41] 10.222.0.58 () {60 vars in 1137 bytes} [Thu Apr 15 19:51:54 2021] POST /compute/v2.1/servers => generated 383 bytes in 4314 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 15 19:51:59.270468 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-3d655e92-4a6c-4c1d-8e2a-04a779dbac1f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:51:59.273412 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-3d655e92-4a6c-4c1d-8e2a-04a779dbac1f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:00.133178 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3d655e92-4a6c-4c1d-8e2a-04a779dbac1f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:00.157454 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-3d655e92-4a6c-4c1d-8e2a-04a779dbac1f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1222 microversion: 2.1 time: 0.900246 Apr 15 19:52:00.163512 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 22/42] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:51:59 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1222 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:01.027182 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a1edf5e2-795c-4456-991c-ce83886d547b tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:01.041489 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a1edf5e2-795c-4456-991c-ce83886d547b tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1315 microversion: 2.1 time: 2.438670 Apr 15 19:52:01.042123 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 21/43] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:51:58 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1315 bytes in 2440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:01.175112 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7be2d3a1-79b8-4787-ad1c-bafd001baf2a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:01.175866 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7be2d3a1-79b8-4787-ad1c-bafd001baf2a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:01.193585 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7be2d3a1-79b8-4787-ad1c-bafd001baf2a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:01.194099 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7be2d3a1-79b8-4787-ad1c-bafd001baf2a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:01.198407 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7be2d3a1-79b8-4787-ad1c-bafd001baf2a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:01.198942 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7be2d3a1-79b8-4787-ad1c-bafd001baf2a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:01.744955 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-7be2d3a1-79b8-4787-ad1c-bafd001baf2a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:01.776892 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7be2d3a1-79b8-4787-ad1c-bafd001baf2a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1218 microversion: 2.1 time: 0.606304 Apr 15 19:52:01.777882 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 23/44] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:01 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1218 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:02.066763 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-26c53aab-68e6-4aee-b6b1-3331da5699d8 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:02.067669 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-26c53aab-68e6-4aee-b6b1-3331da5699d8 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:02.088817 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-26c53aab-68e6-4aee-b6b1-3331da5699d8 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:02.089326 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-26c53aab-68e6-4aee-b6b1-3331da5699d8 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:02.090182 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-26c53aab-68e6-4aee-b6b1-3331da5699d8 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:02.090667 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-26c53aab-68e6-4aee-b6b1-3331da5699d8 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:02.797423 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b93dac59-da2d-4587-b58b-354def2f7781 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:02.798525 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b93dac59-da2d-4587-b58b-354def2f7781 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:02.833445 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b93dac59-da2d-4587-b58b-354def2f7781 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:02.837924 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b93dac59-da2d-4587-b58b-354def2f7781 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:02.838818 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b93dac59-da2d-4587-b58b-354def2f7781 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:02.839341 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b93dac59-da2d-4587-b58b-354def2f7781 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:02.961827 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-26c53aab-68e6-4aee-b6b1-3331da5699d8 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:02.974779 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-26c53aab-68e6-4aee-b6b1-3331da5699d8 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1315 microversion: 2.1 time: 0.912117 Apr 15 19:52:02.976460 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 22/45] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:02 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1315 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:03.788354 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-cfae7482-f717-47ab-b2e6-64e55310097e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'create', calling method: .version_select at 0x7f18d8ac0bf8>, body: {"keypair": {"name": "tempest-keypair-1103302972"}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:52:03.896230 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-cfae7482-f717-47ab-b2e6-64e55310097e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Getting quotas for project b1e9c7381e93406886cc6f3577690f28. Resources: {'key_pairs'} {{(pid=99512) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 15 19:52:03.908525 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-cfae7482-f717-47ab-b2e6-64e55310097e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Getting quotas for user d70e02f8a6aa46c19265378d00f98895 and project b1e9c7381e93406886cc6f3577690f28. Resources: {'key_pairs'} {{(pid=99512) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 15 19:52:03.957115 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b93dac59-da2d-4587-b58b-354def2f7781 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:03.972459 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b93dac59-da2d-4587-b58b-354def2f7781 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1274 microversion: 2.1 time: 1.180839 Apr 15 19:52:03.973401 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 24/46] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:02 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1274 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:52:03.995299 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e37141d7-06ec-4d18-b6fb-81985ed16f36 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:03.996058 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e37141d7-06ec-4d18-b6fb-81985ed16f36 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:04.016580 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e37141d7-06ec-4d18-b6fb-81985ed16f36 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:04.017372 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e37141d7-06ec-4d18-b6fb-81985ed16f36 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:04.020123 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e37141d7-06ec-4d18-b6fb-81985ed16f36 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:04.020751 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e37141d7-06ec-4d18-b6fb-81985ed16f36 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:04.379974 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-cfae7482-f717-47ab-b2e6-64e55310097e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Getting quotas for project b1e9c7381e93406886cc6f3577690f28. Resources: {'key_pairs'} {{(pid=99512) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 15 19:52:04.387592 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-cfae7482-f717-47ab-b2e6-64e55310097e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Getting quotas for user d70e02f8a6aa46c19265378d00f98895 and project b1e9c7381e93406886cc6f3577690f28. Resources: {'key_pairs'} {{(pid=99512) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 15 19:52:04.430816 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-cfae7482-f717-47ab-b2e6-64e55310097e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.909800 Apr 15 19:52:04.432062 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 23/47] 10.222.0.58 () {62 vars in 1189 bytes} [Thu Apr 15 19:52:03 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 912 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Apr 15 19:52:04.653603 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-e37141d7-06ec-4d18-b6fb-81985ed16f36 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:04.697753 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e37141d7-06ec-4d18-b6fb-81985ed16f36 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1315 microversion: 2.1 time: 0.706301 Apr 15 19:52:04.709257 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 25/48] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:03 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1315 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:04.991423 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-084c4b43-424b-434a-b5d7-486e841bbada tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:04.992110 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-084c4b43-424b-434a-b5d7-486e841bbada tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:05.016426 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-084c4b43-424b-434a-b5d7-486e841bbada tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:05.016946 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-084c4b43-424b-434a-b5d7-486e841bbada tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:05.018429 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-084c4b43-424b-434a-b5d7-486e841bbada tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:05.018848 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-084c4b43-424b-434a-b5d7-486e841bbada tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:05.559430 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-084c4b43-424b-434a-b5d7-486e841bbada tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:05.572131 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-084c4b43-424b-434a-b5d7-486e841bbada tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1274 microversion: 2.1 time: 0.585613 Apr 15 19:52:05.575428 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 24/49] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:04 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1274 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:05.726785 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-4695431e-ed63-4083-86f7-4c4119f2742f tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:05.727715 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-4695431e-ed63-4083-86f7-4c4119f2742f tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:05.741142 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4695431e-ed63-4083-86f7-4c4119f2742f tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:05.756131 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4695431e-ed63-4083-86f7-4c4119f2742f tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:05.757056 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4695431e-ed63-4083-86f7-4c4119f2742f tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:05.757645 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4695431e-ed63-4083-86f7-4c4119f2742f tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:06.592754 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-48f6b403-e6e4-4777-949c-f25577e48064 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:06.593414 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-48f6b403-e6e4-4777-949c-f25577e48064 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:06.606041 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-4695431e-ed63-4083-86f7-4c4119f2742f tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:06.614538 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-48f6b403-e6e4-4777-949c-f25577e48064 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:06.615041 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-48f6b403-e6e4-4777-949c-f25577e48064 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:06.615925 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-48f6b403-e6e4-4777-949c-f25577e48064 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:06.616407 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-48f6b403-e6e4-4777-949c-f25577e48064 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:06.632529 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-4695431e-ed63-4083-86f7-4c4119f2742f tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1315 microversion: 2.1 time: 0.909646 Apr 15 19:52:06.633463 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 26/50] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:05 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1315 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:07.098635 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-48f6b403-e6e4-4777-949c-f25577e48064 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:07.114045 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-48f6b403-e6e4-4777-949c-f25577e48064 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1274 microversion: 2.1 time: 0.525134 Apr 15 19:52:07.120448 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 25/51] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:06 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1274 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:07.650588 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f17411b6-c3ea-4921-8cf0-b673f72d0ff0 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:07.652287 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f17411b6-c3ea-4921-8cf0-b673f72d0ff0 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:07.668227 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f17411b6-c3ea-4921-8cf0-b673f72d0ff0 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:07.677277 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f17411b6-c3ea-4921-8cf0-b673f72d0ff0 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:07.678703 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f17411b6-c3ea-4921-8cf0-b673f72d0ff0 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:07.679908 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f17411b6-c3ea-4921-8cf0-b673f72d0ff0 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:08.611867 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-f53de64c-3816-4681-9887-2466374d8bae req-bddd8b3a-13e8-4867-85ed-c955db761cbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfcb0ac4-3cef-44ba-8766-5fa9259164f1", "tag": "27ea1896-c589-442b-9fb0-deb3ed55cb4a"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:52:08.614797 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:52:08.614797 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:52:08.635396 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-f53de64c-3816-4681-9887-2466374d8bae req-bddd8b3a-13e8-4867-85ed-c955db761cbf service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:08.636160 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-f53de64c-3816-4681-9887-2466374d8bae req-bddd8b3a-13e8-4867-85ed-c955db761cbf service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:08.679061 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-f53de64c-3816-4681-9887-2466374d8bae req-bddd8b3a-13e8-4867-85ed-c955db761cbf service nova] Creating event network-changed:27ea1896-c589-442b-9fb0-deb3ed55cb4a for instance dfcb0ac4-3cef-44ba-8766-5fa9259164f1 on hv-cinder-78638 Apr 15 19:52:08.682692 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-f53de64c-3816-4681-9887-2466374d8bae req-bddd8b3a-13e8-4867-85ed-c955db761cbf service nova] Acquired lock "compute-rpcapi-router" {{(pid=99512) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 15 19:52:08.685451 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-63eaefa6-448b-4971-8491-e18de0b56002 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:08.688063 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-63eaefa6-448b-4971-8491-e18de0b56002 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:08.690793 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-63eaefa6-448b-4971-8491-e18de0b56002 None None] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:08.691553 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-63eaefa6-448b-4971-8491-e18de0b56002 None None] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:08.719758 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.compute.rpcapi [None req-63eaefa6-448b-4971-8491-e18de0b56002 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Apr 15 19:52:08.721521 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-63eaefa6-448b-4971-8491-e18de0b56002 None None] Releasing lock "compute-rpcapi-router" {{(pid=99512) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 15 19:52:08.777098 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-63eaefa6-448b-4971-8491-e18de0b56002 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.813864 Apr 15 19:52:08.778434 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 26/52] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:52:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:52:08.787557 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-51d429db-021e-42f2-9ae6-5d6d49a38685 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:08.789149 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-51d429db-021e-42f2-9ae6-5d6d49a38685 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:08.799950 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-51d429db-021e-42f2-9ae6-5d6d49a38685 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:08.800457 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-51d429db-021e-42f2-9ae6-5d6d49a38685 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:08.801466 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-51d429db-021e-42f2-9ae6-5d6d49a38685 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:08.801960 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-51d429db-021e-42f2-9ae6-5d6d49a38685 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:09.197239 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-51d429db-021e-42f2-9ae6-5d6d49a38685 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:09.215966 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-51d429db-021e-42f2-9ae6-5d6d49a38685 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1280 microversion: 2.1 time: 0.430894 Apr 15 19:52:09.216906 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 27/53] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:08 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1280 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:09.898161 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f17411b6-c3ea-4921-8cf0-b673f72d0ff0 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:09.932750 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f17411b6-c3ea-4921-8cf0-b673f72d0ff0 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1315 microversion: 2.1 time: 2.285710 Apr 15 19:52:09.933414 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 27/54] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:07 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1315 bytes in 2288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:10.234758 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-31b24b80-a3d4-4694-a8dd-421963785eb0 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:10.235801 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-31b24b80-a3d4-4694-a8dd-421963785eb0 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:10.250960 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-31b24b80-a3d4-4694-a8dd-421963785eb0 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:10.255683 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-31b24b80-a3d4-4694-a8dd-421963785eb0 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:10.257623 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-31b24b80-a3d4-4694-a8dd-421963785eb0 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:10.260918 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-31b24b80-a3d4-4694-a8dd-421963785eb0 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:10.871388 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-31b24b80-a3d4-4694-a8dd-421963785eb0 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:10.881619 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-31b24b80-a3d4-4694-a8dd-421963785eb0 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1280 microversion: 2.1 time: 0.650843 Apr 15 19:52:10.892273 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 28/55] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:10 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1280 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:10.950770 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7e1d2527-617f-4def-a204-a076ab52ad77 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:10.951483 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7e1d2527-617f-4def-a204-a076ab52ad77 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:10.959942 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7e1d2527-617f-4def-a204-a076ab52ad77 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:10.960668 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7e1d2527-617f-4def-a204-a076ab52ad77 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:10.962134 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7e1d2527-617f-4def-a204-a076ab52ad77 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:10.962807 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7e1d2527-617f-4def-a204-a076ab52ad77 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:11.516214 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-e26a7772-ecf0-4145-8d9a-ae56470a8fcf req-4b966f73-a4d6-47bf-bdda-79e4b16f61d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f202f3f-01c9-41c6-842e-ee96f6b40094", "tag": "8cba2f2f-513f-4df4-9b61-66010fa48a36"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:52:11.522212 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:52:11.522212 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:52:11.543180 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-e26a7772-ecf0-4145-8d9a-ae56470a8fcf req-4b966f73-a4d6-47bf-bdda-79e4b16f61d9 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:11.543744 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-e26a7772-ecf0-4145-8d9a-ae56470a8fcf req-4b966f73-a4d6-47bf-bdda-79e4b16f61d9 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:11.568187 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-e26a7772-ecf0-4145-8d9a-ae56470a8fcf req-4b966f73-a4d6-47bf-bdda-79e4b16f61d9 service nova] Creating event network-changed:8cba2f2f-513f-4df4-9b61-66010fa48a36 for instance 4f202f3f-01c9-41c6-842e-ee96f6b40094 on hv-cinder-78638 Apr 15 19:52:11.573978 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-e26a7772-ecf0-4145-8d9a-ae56470a8fcf req-4b966f73-a4d6-47bf-bdda-79e4b16f61d9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063831 Apr 15 19:52:11.576674 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 29/56] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:52:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:52:11.650951 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-7e1d2527-617f-4def-a204-a076ab52ad77 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:11.675514 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7e1d2527-617f-4def-a204-a076ab52ad77 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1315 microversion: 2.1 time: 0.717231 Apr 15 19:52:11.676576 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 28/57] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:10 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1315 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:11.912131 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-583e91f0-635b-47a4-93ca-fdda55906994 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:11.912984 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-583e91f0-635b-47a4-93ca-fdda55906994 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:11.932164 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-583e91f0-635b-47a4-93ca-fdda55906994 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:11.935885 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-583e91f0-635b-47a4-93ca-fdda55906994 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:11.936986 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-583e91f0-635b-47a4-93ca-fdda55906994 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:11.938177 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-583e91f0-635b-47a4-93ca-fdda55906994 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:12.694651 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b70762da-6d63-4478-8812-2d51b40896f7 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:12.696244 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b70762da-6d63-4478-8812-2d51b40896f7 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:12.706418 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b70762da-6d63-4478-8812-2d51b40896f7 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:12.707389 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b70762da-6d63-4478-8812-2d51b40896f7 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:12.708761 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b70762da-6d63-4478-8812-2d51b40896f7 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:12.709534 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b70762da-6d63-4478-8812-2d51b40896f7 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:13.424163 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-583e91f0-635b-47a4-93ca-fdda55906994 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:13.430324 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b70762da-6d63-4478-8812-2d51b40896f7 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:13.447750 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b70762da-6d63-4478-8812-2d51b40896f7 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1315 microversion: 2.1 time: 0.755524 Apr 15 19:52:13.448403 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 29/58] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:12 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1315 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:13.448837 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-583e91f0-635b-47a4-93ca-fdda55906994 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1322 microversion: 2.1 time: 1.541168 Apr 15 19:52:13.449518 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 30/59] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:11 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1322 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:14.469252 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-58d1a7f4-a9de-426c-a761-69c37bb57636 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:14.471103 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-58d1a7f4-a9de-426c-a761-69c37bb57636 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:14.474098 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f59fac1f-7479-414e-9ab8-fd96b4d61639 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:14.475846 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f59fac1f-7479-414e-9ab8-fd96b4d61639 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:14.479937 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-58d1a7f4-a9de-426c-a761-69c37bb57636 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:14.480689 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-58d1a7f4-a9de-426c-a761-69c37bb57636 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:14.481756 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-58d1a7f4-a9de-426c-a761-69c37bb57636 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:14.482446 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-58d1a7f4-a9de-426c-a761-69c37bb57636 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:14.484056 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f59fac1f-7479-414e-9ab8-fd96b4d61639 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:14.484562 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f59fac1f-7479-414e-9ab8-fd96b4d61639 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:14.485985 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f59fac1f-7479-414e-9ab8-fd96b4d61639 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:14.486973 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f59fac1f-7479-414e-9ab8-fd96b4d61639 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:15.046997 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-58d1a7f4-a9de-426c-a761-69c37bb57636 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:15.055878 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-58d1a7f4-a9de-426c-a761-69c37bb57636 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1315 microversion: 2.1 time: 0.593022 Apr 15 19:52:15.056805 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 30/60] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:14 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1315 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:15.062770 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c0fac467-fbc5-4919-878a-91eeeac2a7e3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-256084474", "imageRef": "10d66d6e-f687-4228-93d1-67502c9b42e2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "985a7b11-3fa6-4a91-bf02-60ccff754b78"}], "security_groups": [{"name": "tempest-securitygroup--1332943141"}], "key_name": "tempest-keypair-1103302972", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:52:15.148163 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f59fac1f-7479-414e-9ab8-fd96b4d61639 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:15.161142 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f59fac1f-7479-414e-9ab8-fd96b4d61639 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1322 microversion: 2.1 time: 0.696188 Apr 15 19:52:15.162098 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 31/61] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:14 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1322 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:15.438722 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.network.neutron [None req-c0fac467-fbc5-4919-878a-91eeeac2a7e3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] validate_networks() for [('985a7b11-3fa6-4a91-bf02-60ccff754b78', None, None, None)] {{(pid=99511) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 15 19:52:16.074574 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-bd5c6cff-6df4-4d5a-b957-8f35d5f696c6 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:16.075227 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-bd5c6cff-6df4-4d5a-b957-8f35d5f696c6 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:16.083476 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bd5c6cff-6df4-4d5a-b957-8f35d5f696c6 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:16.084205 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bd5c6cff-6df4-4d5a-b957-8f35d5f696c6 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:16.085233 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bd5c6cff-6df4-4d5a-b957-8f35d5f696c6 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:16.085891 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bd5c6cff-6df4-4d5a-b957-8f35d5f696c6 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:16.507740 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-bd5c6cff-6df4-4d5a-b957-8f35d5f696c6 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:16.521369 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-bd5c6cff-6df4-4d5a-b957-8f35d5f696c6 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1315 microversion: 2.1 time: 0.449852 Apr 15 19:52:16.524287 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 32/62] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:16 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1315 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:16.543182 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-eee9a7e2-a081-400a-9553-3d675690597e tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:16.544635 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-eee9a7e2-a081-400a-9553-3d675690597e tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:16.556645 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-eee9a7e2-a081-400a-9553-3d675690597e tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:16.557493 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-eee9a7e2-a081-400a-9553-3d675690597e tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:16.558700 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-eee9a7e2-a081-400a-9553-3d675690597e tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:16.559994 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-eee9a7e2-a081-400a-9553-3d675690597e tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:16.608744 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-c0fac467-fbc5-4919-878a-91eeeac2a7e3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Flavor limits 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 15 19:52:16.609337 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-c0fac467-fbc5-4919-878a-91eeeac2a7e3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Image limits 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 15 19:52:16.610068 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-c0fac467-fbc5-4919-878a-91eeeac2a7e3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Flavor pref 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 15 19:52:16.610877 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-c0fac467-fbc5-4919-878a-91eeeac2a7e3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Image pref 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 15 19:52:16.612274 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-c0fac467-fbc5-4919-878a-91eeeac2a7e3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 15 19:52:16.624454 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c0fac467-fbc5-4919-878a-91eeeac2a7e3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:16.624974 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c0fac467-fbc5-4919-878a-91eeeac2a7e3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:16.625832 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c0fac467-fbc5-4919-878a-91eeeac2a7e3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:16.628730 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c0fac467-fbc5-4919-878a-91eeeac2a7e3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:16.664584 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-c0fac467-fbc5-4919-878a-91eeeac2a7e3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Getting quotas for project b1e9c7381e93406886cc6f3577690f28. Resources: {'cores', 'instances', 'ram'} {{(pid=99511) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 15 19:52:16.677828 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-c0fac467-fbc5-4919-878a-91eeeac2a7e3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Getting quotas for user d70e02f8a6aa46c19265378d00f98895 and project b1e9c7381e93406886cc6f3577690f28. Resources: {'cores', 'instances', 'ram'} {{(pid=99511) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 15 19:52:16.693605 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c0fac467-fbc5-4919-878a-91eeeac2a7e3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Going to run 1 instances... {{(pid=99511) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 15 19:52:16.697221 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c0fac467-fbc5-4919-878a-91eeeac2a7e3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='10d66d6e-f687-4228-93d1-67502c9b42e2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 15 19:52:16.765038 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c0fac467-fbc5-4919-878a-91eeeac2a7e3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.706572 Apr 15 19:52:16.775848 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 31/63] 10.222.0.58 () {62 vars in 1178 bytes} [Thu Apr 15 19:52:15 2021] POST /compute/v2.1/servers => generated 402 bytes in 1718 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 15 19:52:16.841790 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-eee9a7e2-a081-400a-9553-3d675690597e tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:16.851960 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-eee9a7e2-a081-400a-9553-3d675690597e tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1322 microversion: 2.1 time: 0.323060 Apr 15 19:52:16.853221 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 33/64] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:16 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1322 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:16.858644 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a6128da2-621e-4635-ad89-5e4aa1b17df6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:16.859572 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a6128da2-621e-4635-ad89-5e4aa1b17df6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:17.003768 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a6128da2-621e-4635-ad89-5e4aa1b17df6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:17.019837 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a6128da2-621e-4635-ad89-5e4aa1b17df6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:17.021756 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a6128da2-621e-4635-ad89-5e4aa1b17df6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:17.026199 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a6128da2-621e-4635-ad89-5e4aa1b17df6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1281 microversion: 2.20 time: 0.171686 Apr 15 19:52:17.027108 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 34/65] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:52:16 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1281 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:52:17.249891 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-010240f3-549c-4a38-8f99-12d4c969eb38 req-2d6089ed-f8aa-4396-ab7b-fedf95fa7bc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c5511dc-7635-490f-86b8-2a3c15d4d90e", "tag": "abc0c4ce-b998-4acc-9da8-075ad1fe41bd"}]} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:52:17.252737 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:52:17.252737 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:52:17.266316 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-010240f3-549c-4a38-8f99-12d4c969eb38 req-2d6089ed-f8aa-4396-ab7b-fedf95fa7bc9 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:17.266813 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-010240f3-549c-4a38-8f99-12d4c969eb38 req-2d6089ed-f8aa-4396-ab7b-fedf95fa7bc9 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:17.301673 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-010240f3-549c-4a38-8f99-12d4c969eb38 req-2d6089ed-f8aa-4396-ab7b-fedf95fa7bc9 service nova] Creating event network-changed:abc0c4ce-b998-4acc-9da8-075ad1fe41bd for instance 3c5511dc-7635-490f-86b8-2a3c15d4d90e on hv-cinder-78638 Apr 15 19:52:17.302407 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-010240f3-549c-4a38-8f99-12d4c969eb38 req-2d6089ed-f8aa-4396-ab7b-fedf95fa7bc9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=99511) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 15 19:52:17.303718 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b0e4c978-b2f2-4b2d-b7d9-e85dfcd81400 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:17.305145 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b0e4c978-b2f2-4b2d-b7d9-e85dfcd81400 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:17.306019 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b0e4c978-b2f2-4b2d-b7d9-e85dfcd81400 None None] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:17.306506 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b0e4c978-b2f2-4b2d-b7d9-e85dfcd81400 None None] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:17.316135 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.compute.rpcapi [None req-b0e4c978-b2f2-4b2d-b7d9-e85dfcd81400 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Apr 15 19:52:17.317095 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b0e4c978-b2f2-4b2d-b7d9-e85dfcd81400 None None] Releasing lock "compute-rpcapi-router" {{(pid=99511) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 15 19:52:17.350271 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b0e4c978-b2f2-4b2d-b7d9-e85dfcd81400 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.571944 Apr 15 19:52:17.351661 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 32/66] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:52:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:52:17.542082 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d039b12c-9432-42e0-8059-092e9069cc0e tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:17.542756 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d039b12c-9432-42e0-8059-092e9069cc0e tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:17.551164 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d039b12c-9432-42e0-8059-092e9069cc0e tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:17.551835 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d039b12c-9432-42e0-8059-092e9069cc0e tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:17.552683 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d039b12c-9432-42e0-8059-092e9069cc0e tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:17.553154 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d039b12c-9432-42e0-8059-092e9069cc0e tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:17.795124 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d039b12c-9432-42e0-8059-092e9069cc0e tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:17.805025 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d039b12c-9432-42e0-8059-092e9069cc0e tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1315 microversion: 2.1 time: 0.267138 Apr 15 19:52:17.805638 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 35/67] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:17 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:17.870732 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-5820ce0d-76d8-482d-aec8-24996a1b5511 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:17.871685 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-5820ce0d-76d8-482d-aec8-24996a1b5511 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:17.880573 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5820ce0d-76d8-482d-aec8-24996a1b5511 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:17.881069 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5820ce0d-76d8-482d-aec8-24996a1b5511 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:17.881916 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5820ce0d-76d8-482d-aec8-24996a1b5511 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:17.882389 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5820ce0d-76d8-482d-aec8-24996a1b5511 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:18.046157 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c7e2d1ed-2cdf-45d5-b29e-b9d1370fc5fe tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:18.046830 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c7e2d1ed-2cdf-45d5-b29e-b9d1370fc5fe tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:18.056125 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c7e2d1ed-2cdf-45d5-b29e-b9d1370fc5fe tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:18.056568 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c7e2d1ed-2cdf-45d5-b29e-b9d1370fc5fe tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:18.057410 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c7e2d1ed-2cdf-45d5-b29e-b9d1370fc5fe tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:18.057900 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c7e2d1ed-2cdf-45d5-b29e-b9d1370fc5fe tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:18.132279 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-5820ce0d-76d8-482d-aec8-24996a1b5511 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:18.145298 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-5820ce0d-76d8-482d-aec8-24996a1b5511 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1322 microversion: 2.1 time: 0.278625 Apr 15 19:52:18.156129 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 33/68] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:17 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:18.188629 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c7e2d1ed-2cdf-45d5-b29e-b9d1370fc5fe tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:18.200322 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c7e2d1ed-2cdf-45d5-b29e-b9d1370fc5fe tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:18.202131 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c7e2d1ed-2cdf-45d5-b29e-b9d1370fc5fe tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:18.203306 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c7e2d1ed-2cdf-45d5-b29e-b9d1370fc5fe tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1285 microversion: 2.20 time: 0.161512 Apr 15 19:52:18.205749 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 36/69] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:52:18 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1285 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 19:52:18.822095 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-49836ea2-ac16-4906-b182-a1bd9cdb1b9d tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:18.823713 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-49836ea2-ac16-4906-b182-a1bd9cdb1b9d tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:18.831695 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-49836ea2-ac16-4906-b182-a1bd9cdb1b9d tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:18.832468 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-49836ea2-ac16-4906-b182-a1bd9cdb1b9d tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:18.833812 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-49836ea2-ac16-4906-b182-a1bd9cdb1b9d tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:18.834526 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-49836ea2-ac16-4906-b182-a1bd9cdb1b9d tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:19.163341 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-79298868-4446-408c-978d-61fb57747369 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:19.164029 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-79298868-4446-408c-978d-61fb57747369 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:19.172219 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-79298868-4446-408c-978d-61fb57747369 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:19.172929 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-79298868-4446-408c-978d-61fb57747369 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:19.175452 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-79298868-4446-408c-978d-61fb57747369 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:19.175452 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-79298868-4446-408c-978d-61fb57747369 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:19.207953 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-49836ea2-ac16-4906-b182-a1bd9cdb1b9d tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:19.218794 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-49836ea2-ac16-4906-b182-a1bd9cdb1b9d tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1315 microversion: 2.1 time: 0.400584 Apr 15 19:52:19.219767 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 34/70] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:18 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1315 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:19.228515 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-2aa7db96-22cd-4a97-adff-23a01aad182b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:19.229397 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-2aa7db96-22cd-4a97-adff-23a01aad182b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:19.237795 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2aa7db96-22cd-4a97-adff-23a01aad182b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:19.238437 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2aa7db96-22cd-4a97-adff-23a01aad182b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:19.239445 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2aa7db96-22cd-4a97-adff-23a01aad182b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:19.240056 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2aa7db96-22cd-4a97-adff-23a01aad182b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:19.380327 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-2aa7db96-22cd-4a97-adff-23a01aad182b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:19.391538 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-2aa7db96-22cd-4a97-adff-23a01aad182b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:19.393485 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-2aa7db96-22cd-4a97-adff-23a01aad182b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:19.395228 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-2aa7db96-22cd-4a97-adff-23a01aad182b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1333 microversion: 2.20 time: 0.174243 Apr 15 19:52:19.396131 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 35/71] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:52:19 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1333 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:52:19.447791 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-79298868-4446-408c-978d-61fb57747369 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:19.456691 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-79298868-4446-408c-978d-61fb57747369 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1322 microversion: 2.1 time: 0.297350 Apr 15 19:52:19.457395 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 37/72] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:19 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:20.237091 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-cec64f26-dc68-4b12-90cc-dfd05fa1c7c4 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:20.237877 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-cec64f26-dc68-4b12-90cc-dfd05fa1c7c4 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:20.245786 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cec64f26-dc68-4b12-90cc-dfd05fa1c7c4 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:20.246291 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cec64f26-dc68-4b12-90cc-dfd05fa1c7c4 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:20.247132 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cec64f26-dc68-4b12-90cc-dfd05fa1c7c4 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:20.247658 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cec64f26-dc68-4b12-90cc-dfd05fa1c7c4 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:20.414900 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f23aa83b-d19d-4dc6-a544-ba7af5c82d2e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:20.415599 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f23aa83b-d19d-4dc6-a544-ba7af5c82d2e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:20.428379 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f23aa83b-d19d-4dc6-a544-ba7af5c82d2e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:20.428822 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f23aa83b-d19d-4dc6-a544-ba7af5c82d2e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:20.429673 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f23aa83b-d19d-4dc6-a544-ba7af5c82d2e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:20.430162 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f23aa83b-d19d-4dc6-a544-ba7af5c82d2e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:20.471257 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-cec64f26-dc68-4b12-90cc-dfd05fa1c7c4 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:20.480571 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-cec64f26-dc68-4b12-90cc-dfd05fa1c7c4 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1315 microversion: 2.1 time: 0.248061 Apr 15 19:52:20.481119 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 36/73] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:20 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:20.486509 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-79f0081b-4bbb-4c14-893d-a0498b9bec8a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:20.487442 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-79f0081b-4bbb-4c14-893d-a0498b9bec8a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:20.495139 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-79f0081b-4bbb-4c14-893d-a0498b9bec8a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:20.495907 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-79f0081b-4bbb-4c14-893d-a0498b9bec8a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:20.496757 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-79f0081b-4bbb-4c14-893d-a0498b9bec8a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:20.497255 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-79f0081b-4bbb-4c14-893d-a0498b9bec8a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:20.558655 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f23aa83b-d19d-4dc6-a544-ba7af5c82d2e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:20.570415 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f23aa83b-d19d-4dc6-a544-ba7af5c82d2e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:20.572599 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f23aa83b-d19d-4dc6-a544-ba7af5c82d2e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:20.574366 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f23aa83b-d19d-4dc6-a544-ba7af5c82d2e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1341 microversion: 2.20 time: 0.163655 Apr 15 19:52:20.575041 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 38/74] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:52:20 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1341 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:52:20.817489 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-79f0081b-4bbb-4c14-893d-a0498b9bec8a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:20.826656 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-79f0081b-4bbb-4c14-893d-a0498b9bec8a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1322 microversion: 2.1 time: 0.344286 Apr 15 19:52:20.832335 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 37/75] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:20 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1322 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:21.498257 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-362fbd16-6a70-427d-aa66-20e4ef35e7ba tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:21.498925 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-362fbd16-6a70-427d-aa66-20e4ef35e7ba tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:21.507405 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-362fbd16-6a70-427d-aa66-20e4ef35e7ba tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:21.507914 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-362fbd16-6a70-427d-aa66-20e4ef35e7ba tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:21.508745 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-362fbd16-6a70-427d-aa66-20e4ef35e7ba tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:21.509229 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-362fbd16-6a70-427d-aa66-20e4ef35e7ba tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:21.593990 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b60ec3b3-595c-4827-a82a-14e1094efd6d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:21.594658 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b60ec3b3-595c-4827-a82a-14e1094efd6d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:21.602413 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b60ec3b3-595c-4827-a82a-14e1094efd6d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:21.602916 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b60ec3b3-595c-4827-a82a-14e1094efd6d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:21.603804 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b60ec3b3-595c-4827-a82a-14e1094efd6d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:21.604289 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b60ec3b3-595c-4827-a82a-14e1094efd6d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:21.743517 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b60ec3b3-595c-4827-a82a-14e1094efd6d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:21.754438 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b60ec3b3-595c-4827-a82a-14e1094efd6d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:21.756670 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b60ec3b3-595c-4827-a82a-14e1094efd6d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:21.758146 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b60ec3b3-595c-4827-a82a-14e1094efd6d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1341 microversion: 2.20 time: 0.168202 Apr 15 19:52:21.759380 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 38/76] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:52:21 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1341 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:52:21.789290 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-362fbd16-6a70-427d-aa66-20e4ef35e7ba tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:21.799381 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-362fbd16-6a70-427d-aa66-20e4ef35e7ba tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1315 microversion: 2.1 time: 0.304555 Apr 15 19:52:21.800069 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 39/77] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:21 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:21.843864 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e7e0608b-b2bf-44a1-95ec-03683fd25262 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:21.844567 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e7e0608b-b2bf-44a1-95ec-03683fd25262 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:21.852938 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e7e0608b-b2bf-44a1-95ec-03683fd25262 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:21.853442 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e7e0608b-b2bf-44a1-95ec-03683fd25262 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:21.854281 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e7e0608b-b2bf-44a1-95ec-03683fd25262 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:21.854774 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e7e0608b-b2bf-44a1-95ec-03683fd25262 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:22.070080 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-e7e0608b-b2bf-44a1-95ec-03683fd25262 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:22.079038 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e7e0608b-b2bf-44a1-95ec-03683fd25262 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1322 microversion: 2.1 time: 0.239074 Apr 15 19:52:22.080203 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 39/78] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:21 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:22.777313 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-27f4ef2e-ff6d-4773-a2f6-f6f31dac0d5c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:22.777955 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-27f4ef2e-ff6d-4773-a2f6-f6f31dac0d5c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:22.785738 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-27f4ef2e-ff6d-4773-a2f6-f6f31dac0d5c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:22.786235 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-27f4ef2e-ff6d-4773-a2f6-f6f31dac0d5c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:22.787070 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-27f4ef2e-ff6d-4773-a2f6-f6f31dac0d5c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:22.787579 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-27f4ef2e-ff6d-4773-a2f6-f6f31dac0d5c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:22.819388 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f6f7fb59-b94e-4c27-8388-a280aa3e9848 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:22.820412 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f6f7fb59-b94e-4c27-8388-a280aa3e9848 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:22.831612 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f6f7fb59-b94e-4c27-8388-a280aa3e9848 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:22.832522 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f6f7fb59-b94e-4c27-8388-a280aa3e9848 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:22.833629 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f6f7fb59-b94e-4c27-8388-a280aa3e9848 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:22.834325 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f6f7fb59-b94e-4c27-8388-a280aa3e9848 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:23.120500 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-27f4ef2e-ff6d-4773-a2f6-f6f31dac0d5c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:23.137876 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-27f4ef2e-ff6d-4773-a2f6-f6f31dac0d5c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:23.139614 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-27f4ef2e-ff6d-4773-a2f6-f6f31dac0d5c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:23.140774 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-27f4ef2e-ff6d-4773-a2f6-f6f31dac0d5c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1341 microversion: 2.20 time: 0.367543 Apr 15 19:52:23.151617 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 40/79] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:52:22 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1341 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:52:23.158241 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-2003f652-e5a0-4b0d-ac02-2f3b5ea7c44c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:23.170293 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-2003f652-e5a0-4b0d-ac02-2f3b5ea7c44c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:23.178817 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2003f652-e5a0-4b0d-ac02-2f3b5ea7c44c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:23.179339 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2003f652-e5a0-4b0d-ac02-2f3b5ea7c44c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:23.180187 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2003f652-e5a0-4b0d-ac02-2f3b5ea7c44c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:23.180670 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2003f652-e5a0-4b0d-ac02-2f3b5ea7c44c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:23.513142 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f6f7fb59-b94e-4c27-8388-a280aa3e9848 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:23.538570 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f6f7fb59-b94e-4c27-8388-a280aa3e9848 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1315 microversion: 2.1 time: 0.725989 Apr 15 19:52:23.549599 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 40/80] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:22 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1315 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:23.666855 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-2003f652-e5a0-4b0d-ac02-2f3b5ea7c44c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:23.676796 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-2003f652-e5a0-4b0d-ac02-2f3b5ea7c44c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1322 microversion: 2.1 time: 0.523617 Apr 15 19:52:23.677703 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 41/81] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:23 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1322 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:24.160422 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d6399cb2-cc8c-4a09-b818-65d6499fd04d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:24.161103 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d6399cb2-cc8c-4a09-b818-65d6499fd04d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:24.186195 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d6399cb2-cc8c-4a09-b818-65d6499fd04d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:24.186912 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d6399cb2-cc8c-4a09-b818-65d6499fd04d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:24.188339 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d6399cb2-cc8c-4a09-b818-65d6499fd04d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:24.189042 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d6399cb2-cc8c-4a09-b818-65d6499fd04d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:24.567933 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6f414de4-6d91-4567-8882-e1baa1fa59d6 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:24.569437 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6f414de4-6d91-4567-8882-e1baa1fa59d6 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:24.577421 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6f414de4-6d91-4567-8882-e1baa1fa59d6 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:24.578014 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6f414de4-6d91-4567-8882-e1baa1fa59d6 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:24.578862 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6f414de4-6d91-4567-8882-e1baa1fa59d6 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:24.579413 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6f414de4-6d91-4567-8882-e1baa1fa59d6 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:24.837051 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d6399cb2-cc8c-4a09-b818-65d6499fd04d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:24.847619 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d6399cb2-cc8c-4a09-b818-65d6499fd04d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:24.849295 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d6399cb2-cc8c-4a09-b818-65d6499fd04d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:24.850469 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d6399cb2-cc8c-4a09-b818-65d6499fd04d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1407 microversion: 2.20 time: 0.694813 Apr 15 19:52:24.851976 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 41/82] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:52:24 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1407 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:52:24.856486 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-cb1cecb3-f3d7-4905-bc66-f393b00a5286 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:24.857074 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-cb1cecb3-f3d7-4905-bc66-f393b00a5286 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:24.865376 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cb1cecb3-f3d7-4905-bc66-f393b00a5286 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:24.865882 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cb1cecb3-f3d7-4905-bc66-f393b00a5286 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:24.866777 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cb1cecb3-f3d7-4905-bc66-f393b00a5286 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:24.867177 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cb1cecb3-f3d7-4905-bc66-f393b00a5286 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:24.929695 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-6f414de4-6d91-4567-8882-e1baa1fa59d6 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:24.939557 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6f414de4-6d91-4567-8882-e1baa1fa59d6 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1315 microversion: 2.1 time: 0.375932 Apr 15 19:52:24.940128 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 42/83] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:24 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:25.084646 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-cb1cecb3-f3d7-4905-bc66-f393b00a5286 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:25.093385 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-cb1cecb3-f3d7-4905-bc66-f393b00a5286 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1322 microversion: 2.1 time: 0.241195 Apr 15 19:52:25.093995 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 42/84] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:24 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:25.870585 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-3d3ea0bc-16e6-4a9c-a88d-6c7bcc53c1a1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:25.871246 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-3d3ea0bc-16e6-4a9c-a88d-6c7bcc53c1a1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:25.879073 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3d3ea0bc-16e6-4a9c-a88d-6c7bcc53c1a1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:25.879611 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3d3ea0bc-16e6-4a9c-a88d-6c7bcc53c1a1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:25.880441 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3d3ea0bc-16e6-4a9c-a88d-6c7bcc53c1a1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:25.880927 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3d3ea0bc-16e6-4a9c-a88d-6c7bcc53c1a1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:25.957951 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-cf23fc54-02da-4b0c-b1f9-74d004f629f2 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:25.958618 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-cf23fc54-02da-4b0c-b1f9-74d004f629f2 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:25.966806 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cf23fc54-02da-4b0c-b1f9-74d004f629f2 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:25.967370 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cf23fc54-02da-4b0c-b1f9-74d004f629f2 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:25.968221 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cf23fc54-02da-4b0c-b1f9-74d004f629f2 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:25.968720 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cf23fc54-02da-4b0c-b1f9-74d004f629f2 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:26.191549 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3d3ea0bc-16e6-4a9c-a88d-6c7bcc53c1a1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:26.201774 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3d3ea0bc-16e6-4a9c-a88d-6c7bcc53c1a1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:26.203483 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3d3ea0bc-16e6-4a9c-a88d-6c7bcc53c1a1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:26.205283 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-3d3ea0bc-16e6-4a9c-a88d-6c7bcc53c1a1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1407 microversion: 2.20 time: 0.338221 Apr 15 19:52:26.205893 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 43/85] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:52:25 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1407 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:52:26.213368 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ba911a47-813e-47f2-9041-028cdb3c2903 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:26.213368 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ba911a47-813e-47f2-9041-028cdb3c2903 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:26.218844 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ba911a47-813e-47f2-9041-028cdb3c2903 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:26.219413 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ba911a47-813e-47f2-9041-028cdb3c2903 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:26.220270 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ba911a47-813e-47f2-9041-028cdb3c2903 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:26.220751 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ba911a47-813e-47f2-9041-028cdb3c2903 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:26.238111 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-cf23fc54-02da-4b0c-b1f9-74d004f629f2 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:26.247583 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-cf23fc54-02da-4b0c-b1f9-74d004f629f2 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1315 microversion: 2.1 time: 0.294080 Apr 15 19:52:26.248281 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 43/86] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:25 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:52:26.442276 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ba911a47-813e-47f2-9041-028cdb3c2903 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:26.451477 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ba911a47-813e-47f2-9041-028cdb3c2903 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1322 microversion: 2.1 time: 0.244237 Apr 15 19:52:26.452180 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 44/87] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:26 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:27.224874 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-1e9fb760-d966-4991-8188-ffdbdcbcb52c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:27.225552 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-1e9fb760-d966-4991-8188-ffdbdcbcb52c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:27.233438 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1e9fb760-d966-4991-8188-ffdbdcbcb52c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:27.234001 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1e9fb760-d966-4991-8188-ffdbdcbcb52c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:27.234842 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1e9fb760-d966-4991-8188-ffdbdcbcb52c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:27.235361 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1e9fb760-d966-4991-8188-ffdbdcbcb52c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:27.266134 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d66c219f-b954-45b4-a0be-0587246a877d tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:27.266800 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d66c219f-b954-45b4-a0be-0587246a877d tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:27.277437 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d66c219f-b954-45b4-a0be-0587246a877d tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:27.278122 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d66c219f-b954-45b4-a0be-0587246a877d tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:27.279488 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d66c219f-b954-45b4-a0be-0587246a877d tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:27.279982 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d66c219f-b954-45b4-a0be-0587246a877d tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:27.569796 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-1e9fb760-d966-4991-8188-ffdbdcbcb52c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:27.574503 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d66c219f-b954-45b4-a0be-0587246a877d tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:27.579831 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-1e9fb760-d966-4991-8188-ffdbdcbcb52c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:27.581520 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-1e9fb760-d966-4991-8188-ffdbdcbcb52c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:27.582718 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-1e9fb760-d966-4991-8188-ffdbdcbcb52c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1407 microversion: 2.20 time: 0.362433 Apr 15 19:52:27.583324 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 44/88] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:52:27 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1407 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:52:27.583824 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d66c219f-b954-45b4-a0be-0587246a877d tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1315 microversion: 2.1 time: 0.321555 Apr 15 19:52:27.584572 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 45/89] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:27 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:27.588357 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c05cd8db-8f6c-4606-847b-29868945c232 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:27.589012 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c05cd8db-8f6c-4606-847b-29868945c232 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:27.596813 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c05cd8db-8f6c-4606-847b-29868945c232 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:27.597303 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c05cd8db-8f6c-4606-847b-29868945c232 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:27.598127 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c05cd8db-8f6c-4606-847b-29868945c232 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:27.598606 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c05cd8db-8f6c-4606-847b-29868945c232 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:27.817306 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c05cd8db-8f6c-4606-847b-29868945c232 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:27.826146 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c05cd8db-8f6c-4606-847b-29868945c232 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1322 microversion: 2.1 time: 0.241778 Apr 15 19:52:27.826745 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 45/90] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:27 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:28.604275 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-00c9f14e-5a5d-4cf5-820f-a1bca7bf2ce0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:28.604945 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-00c9f14e-5a5d-4cf5-820f-a1bca7bf2ce0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:28.611882 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7433bcfc-4612-427f-87a8-bdbc8d231eea tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:28.612557 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7433bcfc-4612-427f-87a8-bdbc8d231eea tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:28.613278 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-00c9f14e-5a5d-4cf5-820f-a1bca7bf2ce0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:28.613859 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-00c9f14e-5a5d-4cf5-820f-a1bca7bf2ce0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:28.614973 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-00c9f14e-5a5d-4cf5-820f-a1bca7bf2ce0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:28.615490 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-00c9f14e-5a5d-4cf5-820f-a1bca7bf2ce0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:28.620434 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7433bcfc-4612-427f-87a8-bdbc8d231eea tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:28.620945 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7433bcfc-4612-427f-87a8-bdbc8d231eea tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:28.621786 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7433bcfc-4612-427f-87a8-bdbc8d231eea tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:28.622256 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7433bcfc-4612-427f-87a8-bdbc8d231eea tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:29.000699 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-7433bcfc-4612-427f-87a8-bdbc8d231eea tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:29.010642 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7433bcfc-4612-427f-87a8-bdbc8d231eea tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1315 microversion: 2.1 time: 0.413020 Apr 15 19:52:29.011499 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 46/91] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:28 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1315 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:29.018431 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-94f78844-650a-4f08-83f2-8ecba0410f9a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:29.018431 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-94f78844-650a-4f08-83f2-8ecba0410f9a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:29.025522 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-94f78844-650a-4f08-83f2-8ecba0410f9a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:29.026034 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-94f78844-650a-4f08-83f2-8ecba0410f9a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:29.026884 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-94f78844-650a-4f08-83f2-8ecba0410f9a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:29.027403 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-94f78844-650a-4f08-83f2-8ecba0410f9a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:29.037652 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-00c9f14e-5a5d-4cf5-820f-a1bca7bf2ce0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:29.048893 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-00c9f14e-5a5d-4cf5-820f-a1bca7bf2ce0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:29.050799 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-00c9f14e-5a5d-4cf5-820f-a1bca7bf2ce0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:29.052886 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-00c9f14e-5a5d-4cf5-820f-a1bca7bf2ce0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1407 microversion: 2.20 time: 0.452376 Apr 15 19:52:29.053970 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 46/92] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:52:28 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1407 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:52:29.448481 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-94f78844-650a-4f08-83f2-8ecba0410f9a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:29.457370 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-94f78844-650a-4f08-83f2-8ecba0410f9a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1322 microversion: 2.1 time: 0.444817 Apr 15 19:52:29.457972 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 47/93] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:29 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1322 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:30.028860 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-76bccedf-4097-4595-83e7-4670b02c1c1a tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:30.029523 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-76bccedf-4097-4595-83e7-4670b02c1c1a tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:30.037377 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-76bccedf-4097-4595-83e7-4670b02c1c1a tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:30.037884 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-76bccedf-4097-4595-83e7-4670b02c1c1a tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:30.038723 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-76bccedf-4097-4595-83e7-4670b02c1c1a tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:30.039206 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-76bccedf-4097-4595-83e7-4670b02c1c1a tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:30.071950 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9f37301b-a6c5-4d3b-bfa8-9e53d6633c84 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:30.072693 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9f37301b-a6c5-4d3b-bfa8-9e53d6633c84 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:30.081714 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9f37301b-a6c5-4d3b-bfa8-9e53d6633c84 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:30.082313 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9f37301b-a6c5-4d3b-bfa8-9e53d6633c84 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:30.083309 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9f37301b-a6c5-4d3b-bfa8-9e53d6633c84 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:30.084035 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9f37301b-a6c5-4d3b-bfa8-9e53d6633c84 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:30.584136 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-76bccedf-4097-4595-83e7-4670b02c1c1a tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:30.593298 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-76bccedf-4097-4595-83e7-4670b02c1c1a tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1315 microversion: 2.1 time: 0.568356 Apr 15 19:52:30.603100 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9f37301b-a6c5-4d3b-bfa8-9e53d6633c84 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:30.603333 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 47/94] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:30 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1315 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:30.603333 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-b01d4eee-981d-4360-bb4e-fba18fe8e9b2 req-52fd61c6-8d51-4710-aa5e-84580506dfbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c0ac4cf-7982-406b-a2f0-115ca5721a10", "tag": "431c18ae-c617-4e1e-bca6-7134661c98e1"}]} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:52:30.603333 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:52:30.603333 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:52:30.605565 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9f37301b-a6c5-4d3b-bfa8-9e53d6633c84 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:30.607362 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9f37301b-a6c5-4d3b-bfa8-9e53d6633c84 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:30.608634 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9f37301b-a6c5-4d3b-bfa8-9e53d6633c84 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1407 microversion: 2.20 time: 0.540818 Apr 15 19:52:30.609543 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 48/95] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:52:30 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1407 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:52:30.615365 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-cc280437-6581-4fdf-8626-1232f7740cf1 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:30.616129 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-cc280437-6581-4fdf-8626-1232f7740cf1 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:30.625033 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cc280437-6581-4fdf-8626-1232f7740cf1 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:30.625447 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cc280437-6581-4fdf-8626-1232f7740cf1 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:30.627045 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cc280437-6581-4fdf-8626-1232f7740cf1 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:30.627725 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cc280437-6581-4fdf-8626-1232f7740cf1 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:30.633729 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-b01d4eee-981d-4360-bb4e-fba18fe8e9b2 req-52fd61c6-8d51-4710-aa5e-84580506dfbb service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:30.634472 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-b01d4eee-981d-4360-bb4e-fba18fe8e9b2 req-52fd61c6-8d51-4710-aa5e-84580506dfbb service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:30.653246 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-b01d4eee-981d-4360-bb4e-fba18fe8e9b2 req-52fd61c6-8d51-4710-aa5e-84580506dfbb service nova] Creating event network-changed:431c18ae-c617-4e1e-bca6-7134661c98e1 for instance 6c0ac4cf-7982-406b-a2f0-115ca5721a10 on hv-cinder-78638 Apr 15 19:52:30.659538 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-b01d4eee-981d-4360-bb4e-fba18fe8e9b2 req-52fd61c6-8d51-4710-aa5e-84580506dfbb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063813 Apr 15 19:52:30.660085 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 48/96] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:52:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:52:31.223733 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-cc280437-6581-4fdf-8626-1232f7740cf1 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:31.232561 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-cc280437-6581-4fdf-8626-1232f7740cf1 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1322 microversion: 2.1 time: 0.622038 Apr 15 19:52:31.234847 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 49/97] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:30 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1322 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:31.613243 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7abf36aa-d6bc-4aef-ba5f-7f7910b508d3 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:31.614027 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7abf36aa-d6bc-4aef-ba5f-7f7910b508d3 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:31.622159 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7abf36aa-d6bc-4aef-ba5f-7f7910b508d3 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:31.622675 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7abf36aa-d6bc-4aef-ba5f-7f7910b508d3 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:31.623544 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7abf36aa-d6bc-4aef-ba5f-7f7910b508d3 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:31.624050 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7abf36aa-d6bc-4aef-ba5f-7f7910b508d3 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:31.629288 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-db4c148b-7c86-4781-8bcb-0b6443e70e95 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:31.630022 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-db4c148b-7c86-4781-8bcb-0b6443e70e95 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:31.638959 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-db4c148b-7c86-4781-8bcb-0b6443e70e95 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:31.639718 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-db4c148b-7c86-4781-8bcb-0b6443e70e95 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:31.640667 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-db4c148b-7c86-4781-8bcb-0b6443e70e95 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:31.641245 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-db4c148b-7c86-4781-8bcb-0b6443e70e95 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:31.955785 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-7abf36aa-d6bc-4aef-ba5f-7f7910b508d3 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:31.961319 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-db4c148b-7c86-4781-8bcb-0b6443e70e95 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:31.965735 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7abf36aa-d6bc-4aef-ba5f-7f7910b508d3 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1315 microversion: 2.1 time: 0.357553 Apr 15 19:52:31.966444 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 49/98] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:31 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:31.976081 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-db4c148b-7c86-4781-8bcb-0b6443e70e95 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:31.976081 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-db4c148b-7c86-4781-8bcb-0b6443e70e95 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:31.977015 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-db4c148b-7c86-4781-8bcb-0b6443e70e95 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1407 microversion: 2.20 time: 0.351734 Apr 15 19:52:31.977854 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 50/99] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:52:31 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1407 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 19:52:32.250051 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f66bde26-51e1-4bcd-a735-3b298a066a27 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:32.250735 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f66bde26-51e1-4bcd-a735-3b298a066a27 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:32.259099 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f66bde26-51e1-4bcd-a735-3b298a066a27 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:32.259642 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f66bde26-51e1-4bcd-a735-3b298a066a27 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:32.260482 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f66bde26-51e1-4bcd-a735-3b298a066a27 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:32.260986 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f66bde26-51e1-4bcd-a735-3b298a066a27 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:32.475772 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f66bde26-51e1-4bcd-a735-3b298a066a27 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:32.484597 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f66bde26-51e1-4bcd-a735-3b298a066a27 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1322 microversion: 2.1 time: 0.238477 Apr 15 19:52:32.485208 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 50/100] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:32 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:32.983706 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ba465965-484d-498c-88b0-29929cf97ac8 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:32.984311 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ba465965-484d-498c-88b0-29929cf97ac8 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:32.992734 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ba465965-484d-498c-88b0-29929cf97ac8 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:32.993230 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ba465965-484d-498c-88b0-29929cf97ac8 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:32.994050 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ba465965-484d-498c-88b0-29929cf97ac8 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:32.994528 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ba465965-484d-498c-88b0-29929cf97ac8 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:32.996256 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9ca7aa8f-7293-4cda-a850-33104d7a60d1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:32.996942 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9ca7aa8f-7293-4cda-a850-33104d7a60d1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:33.004677 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9ca7aa8f-7293-4cda-a850-33104d7a60d1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:33.005189 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9ca7aa8f-7293-4cda-a850-33104d7a60d1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:33.006023 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9ca7aa8f-7293-4cda-a850-33104d7a60d1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:33.006521 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9ca7aa8f-7293-4cda-a850-33104d7a60d1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:33.313944 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ba465965-484d-498c-88b0-29929cf97ac8 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:33.321207 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9ca7aa8f-7293-4cda-a850-33104d7a60d1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:33.322947 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ba465965-484d-498c-88b0-29929cf97ac8 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1315 microversion: 2.1 time: 0.343304 Apr 15 19:52:33.323615 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 51/101] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:32 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:33.331144 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9ca7aa8f-7293-4cda-a850-33104d7a60d1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:33.332853 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9ca7aa8f-7293-4cda-a850-33104d7a60d1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:33.334073 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9ca7aa8f-7293-4cda-a850-33104d7a60d1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1407 microversion: 2.20 time: 0.341909 Apr 15 19:52:33.334674 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 51/102] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:52:32 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1407 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:52:33.502105 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-abb4af60-c59e-4b01-abe6-9cb824b9b708 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:33.502773 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-abb4af60-c59e-4b01-abe6-9cb824b9b708 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:33.510542 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-abb4af60-c59e-4b01-abe6-9cb824b9b708 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:33.511048 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-abb4af60-c59e-4b01-abe6-9cb824b9b708 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:33.511908 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-abb4af60-c59e-4b01-abe6-9cb824b9b708 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:33.512396 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-abb4af60-c59e-4b01-abe6-9cb824b9b708 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:33.957744 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-abb4af60-c59e-4b01-abe6-9cb824b9b708 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:33.966678 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-abb4af60-c59e-4b01-abe6-9cb824b9b708 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1322 microversion: 2.1 time: 0.468543 Apr 15 19:52:33.967315 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 52/103] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:33 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1322 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:34.188638 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-62739f96-1f62-411c-9360-2e229de3bb6f req-f5ba1318-f19a-4b60-b517-0ca492a64615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f202f3f-01c9-41c6-842e-ee96f6b40094", "name": "network-vif-plugged", "status": "completed", "tag": "8cba2f2f-513f-4df4-9b61-66010fa48a36"}]} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:52:34.190940 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:52:34.190940 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:52:34.199898 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-62739f96-1f62-411c-9360-2e229de3bb6f req-f5ba1318-f19a-4b60-b517-0ca492a64615 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:34.200630 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-62739f96-1f62-411c-9360-2e229de3bb6f req-f5ba1318-f19a-4b60-b517-0ca492a64615 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:34.220925 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-62739f96-1f62-411c-9360-2e229de3bb6f req-f5ba1318-f19a-4b60-b517-0ca492a64615 service nova] Creating event network-vif-plugged:8cba2f2f-513f-4df4-9b61-66010fa48a36 for instance 4f202f3f-01c9-41c6-842e-ee96f6b40094 on hv-cinder-78638 Apr 15 19:52:34.226365 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-62739f96-1f62-411c-9360-2e229de3bb6f req-f5ba1318-f19a-4b60-b517-0ca492a64615 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108051 Apr 15 19:52:34.227024 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 52/104] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:52:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:52:34.341401 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-aca87629-8981-4a66-98d6-b9485c38b169 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:34.342147 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-aca87629-8981-4a66-98d6-b9485c38b169 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:34.350507 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-aca87629-8981-4a66-98d6-b9485c38b169 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:34.351108 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-aca87629-8981-4a66-98d6-b9485c38b169 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:34.352045 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-aca87629-8981-4a66-98d6-b9485c38b169 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:34.352750 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-aca87629-8981-4a66-98d6-b9485c38b169 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:34.354310 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-5b7007bf-e75d-443b-a06d-033c13df34d2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:34.355090 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-5b7007bf-e75d-443b-a06d-033c13df34d2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:34.373098 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5b7007bf-e75d-443b-a06d-033c13df34d2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:34.373613 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5b7007bf-e75d-443b-a06d-033c13df34d2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:34.374521 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5b7007bf-e75d-443b-a06d-033c13df34d2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:34.375046 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5b7007bf-e75d-443b-a06d-033c13df34d2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:34.689187 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-aca87629-8981-4a66-98d6-b9485c38b169 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:34.693237 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-5b7007bf-e75d-443b-a06d-033c13df34d2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:34.698609 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-aca87629-8981-4a66-98d6-b9485c38b169 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1315 microversion: 2.1 time: 0.361247 Apr 15 19:52:34.699301 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 53/105] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:34 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:34.702790 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-5b7007bf-e75d-443b-a06d-033c13df34d2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:34.704495 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-5b7007bf-e75d-443b-a06d-033c13df34d2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:34.705647 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-5b7007bf-e75d-443b-a06d-033c13df34d2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1407 microversion: 2.20 time: 0.355860 Apr 15 19:52:34.706386 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 53/106] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:52:34 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1407 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:52:34.984735 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c2733ad5-55eb-4f63-bbd5-e485fcac98bc tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:34.985393 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c2733ad5-55eb-4f63-bbd5-e485fcac98bc tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:34.994194 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c2733ad5-55eb-4f63-bbd5-e485fcac98bc tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:34.994779 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c2733ad5-55eb-4f63-bbd5-e485fcac98bc tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:34.995828 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c2733ad5-55eb-4f63-bbd5-e485fcac98bc tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:34.996521 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c2733ad5-55eb-4f63-bbd5-e485fcac98bc tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:35.210610 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c2733ad5-55eb-4f63-bbd5-e485fcac98bc tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:35.219648 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c2733ad5-55eb-4f63-bbd5-e485fcac98bc tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1322 microversion: 2.1 time: 0.238842 Apr 15 19:52:35.220266 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 54/107] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:34 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:35.716886 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-5edf4fc0-858e-4055-8548-b7a48e6009a0 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:35.717566 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-5edf4fc0-858e-4055-8548-b7a48e6009a0 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:35.724712 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-8b5298b8-9ead-4163-9547-a4c4ad1b3b31 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:35.725132 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-8b5298b8-9ead-4163-9547-a4c4ad1b3b31 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:35.725663 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5edf4fc0-858e-4055-8548-b7a48e6009a0 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:35.726171 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5edf4fc0-858e-4055-8548-b7a48e6009a0 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:35.727013 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5edf4fc0-858e-4055-8548-b7a48e6009a0 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:35.727583 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5edf4fc0-858e-4055-8548-b7a48e6009a0 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:35.732719 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8b5298b8-9ead-4163-9547-a4c4ad1b3b31 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:35.733219 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8b5298b8-9ead-4163-9547-a4c4ad1b3b31 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:35.734038 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8b5298b8-9ead-4163-9547-a4c4ad1b3b31 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:35.734519 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8b5298b8-9ead-4163-9547-a4c4ad1b3b31 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:36.058687 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-5edf4fc0-858e-4055-8548-b7a48e6009a0 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:36.063161 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-8b5298b8-9ead-4163-9547-a4c4ad1b3b31 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:36.067693 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-5edf4fc0-858e-4055-8548-b7a48e6009a0 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1315 microversion: 2.1 time: 0.354892 Apr 15 19:52:36.068321 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 54/108] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:35 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:52:36.072610 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-8b5298b8-9ead-4163-9547-a4c4ad1b3b31 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:36.074270 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-8b5298b8-9ead-4163-9547-a4c4ad1b3b31 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:36.075435 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-8b5298b8-9ead-4163-9547-a4c4ad1b3b31 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1407 microversion: 2.20 time: 0.354887 Apr 15 19:52:36.076013 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 55/109] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:52:35 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1407 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:52:36.237439 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-75e1c864-b350-4ea1-9d1d-f1a0cf84e04f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:36.238154 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-75e1c864-b350-4ea1-9d1d-f1a0cf84e04f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:36.246091 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-75e1c864-b350-4ea1-9d1d-f1a0cf84e04f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:36.246593 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-75e1c864-b350-4ea1-9d1d-f1a0cf84e04f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:36.247441 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-75e1c864-b350-4ea1-9d1d-f1a0cf84e04f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:36.247927 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-75e1c864-b350-4ea1-9d1d-f1a0cf84e04f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:36.259059 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-67f1fb30-6482-455f-abf6-906d19ea0fe0 req-e7c8056d-6051-4870-ab9d-58bfe65a6eee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfcb0ac4-3cef-44ba-8766-5fa9259164f1", "name": "network-vif-plugged", "status": "completed", "tag": "27ea1896-c589-442b-9fb0-deb3ed55cb4a"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:52:36.260868 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:52:36.260868 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:52:36.270131 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-67f1fb30-6482-455f-abf6-906d19ea0fe0 req-e7c8056d-6051-4870-ab9d-58bfe65a6eee service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:36.270615 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-67f1fb30-6482-455f-abf6-906d19ea0fe0 req-e7c8056d-6051-4870-ab9d-58bfe65a6eee service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:36.287797 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-67f1fb30-6482-455f-abf6-906d19ea0fe0 req-e7c8056d-6051-4870-ab9d-58bfe65a6eee service nova] Creating event network-vif-plugged:27ea1896-c589-442b-9fb0-deb3ed55cb4a for instance dfcb0ac4-3cef-44ba-8766-5fa9259164f1 on hv-cinder-78638 Apr 15 19:52:36.292966 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-67f1fb30-6482-455f-abf6-906d19ea0fe0 req-e7c8056d-6051-4870-ab9d-58bfe65a6eee service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037837 Apr 15 19:52:36.293571 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 56/110] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:52:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:52:36.462411 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-75e1c864-b350-4ea1-9d1d-f1a0cf84e04f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:36.471723 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-75e1c864-b350-4ea1-9d1d-f1a0cf84e04f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1322 microversion: 2.1 time: 0.238849 Apr 15 19:52:36.472345 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 55/111] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:36 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:37.086516 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-8eaee7db-d241-4c98-99ba-2f3306fca794 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:37.087320 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-8eaee7db-d241-4c98-99ba-2f3306fca794 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:37.094167 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-1546a866-5408-4cb4-ad8b-0771e87c3c74 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:37.094826 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-1546a866-5408-4cb4-ad8b-0771e87c3c74 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:37.095430 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8eaee7db-d241-4c98-99ba-2f3306fca794 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:37.095939 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8eaee7db-d241-4c98-99ba-2f3306fca794 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:37.096781 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8eaee7db-d241-4c98-99ba-2f3306fca794 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:37.097271 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8eaee7db-d241-4c98-99ba-2f3306fca794 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:37.102933 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1546a866-5408-4cb4-ad8b-0771e87c3c74 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:37.103490 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1546a866-5408-4cb4-ad8b-0771e87c3c74 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:37.104320 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1546a866-5408-4cb4-ad8b-0771e87c3c74 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:37.104845 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1546a866-5408-4cb4-ad8b-0771e87c3c74 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:37.587349 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-1546a866-5408-4cb4-ad8b-0771e87c3c74 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:37.596357 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-8eaee7db-d241-4c98-99ba-2f3306fca794 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:37.612202 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-8eaee7db-d241-4c98-99ba-2f3306fca794 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1315 microversion: 2.1 time: 0.527512 Apr 15 19:52:37.613543 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-1546a866-5408-4cb4-ad8b-0771e87c3c74 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:37.614643 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 57/112] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:37 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1315 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:37.624828 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-1546a866-5408-4cb4-ad8b-0771e87c3c74 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:37.624828 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-1546a866-5408-4cb4-ad8b-0771e87c3c74 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1407 microversion: 2.20 time: 0.528238 Apr 15 19:52:37.635043 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c1243ebe-f0ea-4cca-9a77-88146a20f953 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:37.635553 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c1243ebe-f0ea-4cca-9a77-88146a20f953 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:37.638497 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 56/113] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:52:37 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1407 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 19:52:37.669412 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c1243ebe-f0ea-4cca-9a77-88146a20f953 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:37.669929 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c1243ebe-f0ea-4cca-9a77-88146a20f953 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:37.670795 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c1243ebe-f0ea-4cca-9a77-88146a20f953 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:37.671307 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c1243ebe-f0ea-4cca-9a77-88146a20f953 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:37.973727 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c1243ebe-f0ea-4cca-9a77-88146a20f953 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:37.982655 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c1243ebe-f0ea-4cca-9a77-88146a20f953 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1322 microversion: 2.1 time: 0.366860 Apr 15 19:52:37.983388 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 58/114] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:37 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1322 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:38.632676 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-cc4a4e13-937f-4778-905e-d3ff7952329c tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:38.633390 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-cc4a4e13-937f-4778-905e-d3ff7952329c tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:38.636812 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-68ae838b-3d33-4145-b07a-d4cf228c84e0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:38.637559 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-68ae838b-3d33-4145-b07a-d4cf228c84e0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:38.641803 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cc4a4e13-937f-4778-905e-d3ff7952329c tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:38.642444 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cc4a4e13-937f-4778-905e-d3ff7952329c tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:38.643299 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cc4a4e13-937f-4778-905e-d3ff7952329c tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:38.643795 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cc4a4e13-937f-4778-905e-d3ff7952329c tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:38.645460 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-68ae838b-3d33-4145-b07a-d4cf228c84e0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:38.645964 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-68ae838b-3d33-4145-b07a-d4cf228c84e0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:38.646887 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-68ae838b-3d33-4145-b07a-d4cf228c84e0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:38.647419 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-68ae838b-3d33-4145-b07a-d4cf228c84e0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:39.306686 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-cc4a4e13-937f-4778-905e-d3ff7952329c tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:39.311402 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-68ae838b-3d33-4145-b07a-d4cf228c84e0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:39.315577 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-cc4a4e13-937f-4778-905e-d3ff7952329c tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1315 microversion: 2.1 time: 0.686887 Apr 15 19:52:39.316201 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 57/115] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:38 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1315 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:39.320929 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6218059b-c2af-4028-a1cb-8ae2ef872618 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:39.321090 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-68ae838b-3d33-4145-b07a-d4cf228c84e0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:39.321585 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6218059b-c2af-4028-a1cb-8ae2ef872618 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:39.323010 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-68ae838b-3d33-4145-b07a-d4cf228c84e0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:39.324310 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-68ae838b-3d33-4145-b07a-d4cf228c84e0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1407 microversion: 2.20 time: 0.691569 Apr 15 19:52:39.326476 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 59/116] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:52:38 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1407 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 19:52:39.330115 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6218059b-c2af-4028-a1cb-8ae2ef872618 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:39.330668 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6218059b-c2af-4028-a1cb-8ae2ef872618 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:39.331560 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6218059b-c2af-4028-a1cb-8ae2ef872618 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:39.332052 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6218059b-c2af-4028-a1cb-8ae2ef872618 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:39.544940 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-6218059b-c2af-4028-a1cb-8ae2ef872618 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:39.553897 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6218059b-c2af-4028-a1cb-8ae2ef872618 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1322 microversion: 2.1 time: 0.236601 Apr 15 19:52:39.554515 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 58/117] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:39 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:40.333531 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c94f089c-6e7a-4976-87da-1820444daa5a tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:40.334191 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c94f089c-6e7a-4976-87da-1820444daa5a tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:40.341953 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c94f089c-6e7a-4976-87da-1820444daa5a tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:40.342452 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c94f089c-6e7a-4976-87da-1820444daa5a tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:40.343290 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c94f089c-6e7a-4976-87da-1820444daa5a tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:40.343780 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c94f089c-6e7a-4976-87da-1820444daa5a tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:40.345890 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-29454338-94a2-4d2e-826c-8a61dde23e9e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:40.346559 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-29454338-94a2-4d2e-826c-8a61dde23e9e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:40.354326 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-29454338-94a2-4d2e-826c-8a61dde23e9e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:40.354833 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-29454338-94a2-4d2e-826c-8a61dde23e9e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:40.355697 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-29454338-94a2-4d2e-826c-8a61dde23e9e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:40.356190 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-29454338-94a2-4d2e-826c-8a61dde23e9e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:40.660627 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c94f089c-6e7a-4976-87da-1820444daa5a tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:40.668116 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-29454338-94a2-4d2e-826c-8a61dde23e9e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:40.669773 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c94f089c-6e7a-4976-87da-1820444daa5a tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1315 microversion: 2.1 time: 0.340396 Apr 15 19:52:40.670380 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 60/118] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:40 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:40.676554 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b67d49f6-2a0a-4fbf-98ae-c8467c4ebd05 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:40.677456 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b67d49f6-2a0a-4fbf-98ae-c8467c4ebd05 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:40.678869 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-29454338-94a2-4d2e-826c-8a61dde23e9e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:40.680688 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-29454338-94a2-4d2e-826c-8a61dde23e9e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:40.682028 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-29454338-94a2-4d2e-826c-8a61dde23e9e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1407 microversion: 2.20 time: 0.340723 Apr 15 19:52:40.682847 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 59/119] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:52:40 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1407 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 19:52:40.686117 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b67d49f6-2a0a-4fbf-98ae-c8467c4ebd05 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:40.686703 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b67d49f6-2a0a-4fbf-98ae-c8467c4ebd05 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:40.687687 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b67d49f6-2a0a-4fbf-98ae-c8467c4ebd05 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:40.688204 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b67d49f6-2a0a-4fbf-98ae-c8467c4ebd05 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:40.901750 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b67d49f6-2a0a-4fbf-98ae-c8467c4ebd05 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:40.910983 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b67d49f6-2a0a-4fbf-98ae-c8467c4ebd05 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1322 microversion: 2.1 time: 0.239211 Apr 15 19:52:40.911627 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 61/120] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:40 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:41.688131 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e5d85348-8990-430e-9ef9-dd1ae50300cf tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:41.688845 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e5d85348-8990-430e-9ef9-dd1ae50300cf tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:41.697284 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e5d85348-8990-430e-9ef9-dd1ae50300cf tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:41.697795 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e5d85348-8990-430e-9ef9-dd1ae50300cf tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:41.698632 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e5d85348-8990-430e-9ef9-dd1ae50300cf tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:41.699122 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e5d85348-8990-430e-9ef9-dd1ae50300cf tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:41.700960 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c1c7036a-b197-4333-ba74-f22cf207ee9b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:41.701671 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c1c7036a-b197-4333-ba74-f22cf207ee9b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:41.709621 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c1c7036a-b197-4333-ba74-f22cf207ee9b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:41.710120 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c1c7036a-b197-4333-ba74-f22cf207ee9b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:41.710945 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c1c7036a-b197-4333-ba74-f22cf207ee9b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:41.711455 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c1c7036a-b197-4333-ba74-f22cf207ee9b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:42.009082 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-e5d85348-8990-430e-9ef9-dd1ae50300cf tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:42.017822 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e5d85348-8990-430e-9ef9-dd1ae50300cf tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1315 microversion: 2.1 time: 0.333624 Apr 15 19:52:42.018446 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 60/121] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:41 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:42.019603 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c1c7036a-b197-4333-ba74-f22cf207ee9b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:42.023502 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-597b1d9d-d02f-476b-ad2b-ee4eb469b0ab tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:42.023956 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-597b1d9d-d02f-476b-ad2b-ee4eb469b0ab tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:42.030289 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c1c7036a-b197-4333-ba74-f22cf207ee9b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:42.032080 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c1c7036a-b197-4333-ba74-f22cf207ee9b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:42.032205 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-597b1d9d-d02f-476b-ad2b-ee4eb469b0ab tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:42.033187 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-597b1d9d-d02f-476b-ad2b-ee4eb469b0ab tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:42.033989 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c1c7036a-b197-4333-ba74-f22cf207ee9b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1407 microversion: 2.20 time: 0.337043 Apr 15 19:52:42.034089 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-597b1d9d-d02f-476b-ad2b-ee4eb469b0ab tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:42.034492 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-597b1d9d-d02f-476b-ad2b-ee4eb469b0ab tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:42.034860 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 62/122] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:52:41 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1407 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 19:52:42.246560 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-597b1d9d-d02f-476b-ad2b-ee4eb469b0ab tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:42.255434 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-597b1d9d-d02f-476b-ad2b-ee4eb469b0ab tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1322 microversion: 2.1 time: 0.235954 Apr 15 19:52:42.256064 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 61/123] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:42 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:43.034977 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-126b490f-4fe4-409e-9193-f81ca8736cb7 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:43.035665 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-126b490f-4fe4-409e-9193-f81ca8736cb7 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:43.043450 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-126b490f-4fe4-409e-9193-f81ca8736cb7 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:43.044191 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-126b490f-4fe4-409e-9193-f81ca8736cb7 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:43.045018 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-126b490f-4fe4-409e-9193-f81ca8736cb7 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:43.045500 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-126b490f-4fe4-409e-9193-f81ca8736cb7 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:43.053674 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-1d606d94-3a8a-45eb-9cd2-0772b8113fc2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:43.054334 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-1d606d94-3a8a-45eb-9cd2-0772b8113fc2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:43.062027 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1d606d94-3a8a-45eb-9cd2-0772b8113fc2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:43.062535 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1d606d94-3a8a-45eb-9cd2-0772b8113fc2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:43.063373 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1d606d94-3a8a-45eb-9cd2-0772b8113fc2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:43.064423 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1d606d94-3a8a-45eb-9cd2-0772b8113fc2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:43.366719 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-126b490f-4fe4-409e-9193-f81ca8736cb7 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:43.371213 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-1d606d94-3a8a-45eb-9cd2-0772b8113fc2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:43.375591 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-126b490f-4fe4-409e-9193-f81ca8736cb7 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1315 microversion: 2.1 time: 0.344467 Apr 15 19:52:43.376336 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 63/124] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:43 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:43.380622 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-1d606d94-3a8a-45eb-9cd2-0772b8113fc2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:43.381023 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-bcd8d56b-382e-4fc0-bcdf-0017a05a5761 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:43.381678 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-bcd8d56b-382e-4fc0-bcdf-0017a05a5761 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:43.382283 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-1d606d94-3a8a-45eb-9cd2-0772b8113fc2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:43.383458 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-1d606d94-3a8a-45eb-9cd2-0772b8113fc2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1407 microversion: 2.20 time: 0.333808 Apr 15 19:52:43.384035 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 62/125] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:52:43 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1407 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 19:52:43.389165 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bcd8d56b-382e-4fc0-bcdf-0017a05a5761 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:43.389664 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bcd8d56b-382e-4fc0-bcdf-0017a05a5761 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:43.390483 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bcd8d56b-382e-4fc0-bcdf-0017a05a5761 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:43.390965 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bcd8d56b-382e-4fc0-bcdf-0017a05a5761 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:43.603397 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-bcd8d56b-382e-4fc0-bcdf-0017a05a5761 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:43.612701 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-bcd8d56b-382e-4fc0-bcdf-0017a05a5761 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1322 microversion: 2.1 time: 0.235282 Apr 15 19:52:43.613305 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 64/126] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:43 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:44.394310 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-da0b7be3-6827-4373-b9c9-6f965b8d286d tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:44.395016 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-da0b7be3-6827-4373-b9c9-6f965b8d286d tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:44.402302 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c9a6c355-ebb4-4f23-8635-787d25cec958 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:44.402938 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-da0b7be3-6827-4373-b9c9-6f965b8d286d tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:44.403052 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c9a6c355-ebb4-4f23-8635-787d25cec958 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:44.403505 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-da0b7be3-6827-4373-b9c9-6f965b8d286d tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:44.404353 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-da0b7be3-6827-4373-b9c9-6f965b8d286d tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:44.404854 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-da0b7be3-6827-4373-b9c9-6f965b8d286d tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:44.410688 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c9a6c355-ebb4-4f23-8635-787d25cec958 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:44.411190 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c9a6c355-ebb4-4f23-8635-787d25cec958 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:44.412046 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c9a6c355-ebb4-4f23-8635-787d25cec958 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:44.412525 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c9a6c355-ebb4-4f23-8635-787d25cec958 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:44.730475 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-da0b7be3-6827-4373-b9c9-6f965b8d286d tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:44.738140 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c9a6c355-ebb4-4f23-8635-787d25cec958 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:44.743290 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-da0b7be3-6827-4373-b9c9-6f965b8d286d tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1315 microversion: 2.1 time: 0.353517 Apr 15 19:52:44.744122 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 63/127] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:44 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:44.747529 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c9a6c355-ebb4-4f23-8635-787d25cec958 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:44.748609 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d605ed0b-46c9-4fdd-aebf-1fcb2a9bfd21 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:44.749191 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c9a6c355-ebb4-4f23-8635-787d25cec958 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:44.749301 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d605ed0b-46c9-4fdd-aebf-1fcb2a9bfd21 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:44.750337 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c9a6c355-ebb4-4f23-8635-787d25cec958 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1407 microversion: 2.20 time: 0.352080 Apr 15 19:52:44.754109 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 65/128] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:52:44 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1407 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:52:44.757608 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d605ed0b-46c9-4fdd-aebf-1fcb2a9bfd21 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:44.758119 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d605ed0b-46c9-4fdd-aebf-1fcb2a9bfd21 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:44.758957 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d605ed0b-46c9-4fdd-aebf-1fcb2a9bfd21 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:44.759477 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d605ed0b-46c9-4fdd-aebf-1fcb2a9bfd21 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:44.980880 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d605ed0b-46c9-4fdd-aebf-1fcb2a9bfd21 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:44.990259 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d605ed0b-46c9-4fdd-aebf-1fcb2a9bfd21 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1322 microversion: 2.1 time: 0.245287 Apr 15 19:52:44.990885 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 64/129] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:44 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:45.761687 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-fdf4c183-b082-47e0-88cc-c235b6dc9927 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:45.762353 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-fdf4c183-b082-47e0-88cc-c235b6dc9927 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:45.770414 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-77441257-5edf-430b-82c7-ef3a58037a90 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:45.771076 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fdf4c183-b082-47e0-88cc-c235b6dc9927 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:45.771217 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-77441257-5edf-430b-82c7-ef3a58037a90 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:45.771621 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fdf4c183-b082-47e0-88cc-c235b6dc9927 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:45.772505 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fdf4c183-b082-47e0-88cc-c235b6dc9927 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:45.773043 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fdf4c183-b082-47e0-88cc-c235b6dc9927 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:45.778768 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-77441257-5edf-430b-82c7-ef3a58037a90 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:45.779293 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-77441257-5edf-430b-82c7-ef3a58037a90 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:45.780107 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-77441257-5edf-430b-82c7-ef3a58037a90 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:45.780605 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-77441257-5edf-430b-82c7-ef3a58037a90 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:46.091950 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-fdf4c183-b082-47e0-88cc-c235b6dc9927 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:46.096435 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-77441257-5edf-430b-82c7-ef3a58037a90 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:46.101025 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-fdf4c183-b082-47e0-88cc-c235b6dc9927 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1315 microversion: 2.1 time: 0.343418 Apr 15 19:52:46.101654 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 66/130] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:45 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:46.106213 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-77441257-5edf-430b-82c7-ef3a58037a90 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:46.106348 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-8140c966-7c41-438d-ae28-99698e89245f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:46.106895 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-8140c966-7c41-438d-ae28-99698e89245f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:46.108006 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-77441257-5edf-430b-82c7-ef3a58037a90 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:46.109174 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-77441257-5edf-430b-82c7-ef3a58037a90 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1407 microversion: 2.20 time: 0.343505 Apr 15 19:52:46.109962 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 65/131] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:52:45 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1407 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:52:46.114868 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8140c966-7c41-438d-ae28-99698e89245f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:46.115440 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8140c966-7c41-438d-ae28-99698e89245f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:46.116273 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8140c966-7c41-438d-ae28-99698e89245f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:46.116763 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8140c966-7c41-438d-ae28-99698e89245f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:46.329700 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-8140c966-7c41-438d-ae28-99698e89245f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:46.338387 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-8140c966-7c41-438d-ae28-99698e89245f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1322 microversion: 2.1 time: 0.235718 Apr 15 19:52:46.339000 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 67/132] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:46 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:47.118985 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ad31fe28-f03e-4ff8-8dee-a1ed6189272a tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:47.119707 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ad31fe28-f03e-4ff8-8dee-a1ed6189272a tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:47.128034 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ad31fe28-f03e-4ff8-8dee-a1ed6189272a tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:47.129945 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ad31fe28-f03e-4ff8-8dee-a1ed6189272a tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:47.130074 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-2990718e-4513-42c2-b2d6-a28f2a66d052 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:47.130180 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ad31fe28-f03e-4ff8-8dee-a1ed6189272a tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:47.130321 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-2990718e-4513-42c2-b2d6-a28f2a66d052 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:47.130429 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ad31fe28-f03e-4ff8-8dee-a1ed6189272a tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:47.138113 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2990718e-4513-42c2-b2d6-a28f2a66d052 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:47.138613 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2990718e-4513-42c2-b2d6-a28f2a66d052 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:47.139486 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2990718e-4513-42c2-b2d6-a28f2a66d052 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:47.139971 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2990718e-4513-42c2-b2d6-a28f2a66d052 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:47.434966 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ad31fe28-f03e-4ff8-8dee-a1ed6189272a tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:47.444686 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ad31fe28-f03e-4ff8-8dee-a1ed6189272a tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1315 microversion: 2.1 time: 0.329223 Apr 15 19:52:47.447429 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 66/133] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:47 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1315 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:47.449841 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-5745bc9e-e414-4d1e-9561-3b8310152ae7 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:47.450800 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-5745bc9e-e414-4d1e-9561-3b8310152ae7 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:47.457540 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-2990718e-4513-42c2-b2d6-a28f2a66d052 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:47.459858 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5745bc9e-e414-4d1e-9561-3b8310152ae7 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:47.460611 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5745bc9e-e414-4d1e-9561-3b8310152ae7 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:47.461454 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5745bc9e-e414-4d1e-9561-3b8310152ae7 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:47.462228 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5745bc9e-e414-4d1e-9561-3b8310152ae7 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:47.467573 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-2990718e-4513-42c2-b2d6-a28f2a66d052 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:47.469306 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-2990718e-4513-42c2-b2d6-a28f2a66d052 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:47.470524 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-2990718e-4513-42c2-b2d6-a28f2a66d052 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1407 microversion: 2.20 time: 0.345950 Apr 15 19:52:47.471343 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 68/134] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:52:47 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1407 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 19:52:47.677607 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-5745bc9e-e414-4d1e-9561-3b8310152ae7 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:47.686357 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-5745bc9e-e414-4d1e-9561-3b8310152ae7 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1322 microversion: 2.1 time: 0.240082 Apr 15 19:52:47.686973 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 67/135] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:47 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:48.463630 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-48a302e8-2d67-4896-9508-ff0319bbccc5 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:48.464291 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-48a302e8-2d67-4896-9508-ff0319bbccc5 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:48.472646 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-48a302e8-2d67-4896-9508-ff0319bbccc5 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:48.473145 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-48a302e8-2d67-4896-9508-ff0319bbccc5 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:48.473967 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-48a302e8-2d67-4896-9508-ff0319bbccc5 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:48.474450 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-48a302e8-2d67-4896-9508-ff0319bbccc5 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:48.489448 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-688ff1e2-eeb5-43bd-9d3b-7ad22cf4f3d9 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:48.490516 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-688ff1e2-eeb5-43bd-9d3b-7ad22cf4f3d9 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:48.498263 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-688ff1e2-eeb5-43bd-9d3b-7ad22cf4f3d9 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:48.498768 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-688ff1e2-eeb5-43bd-9d3b-7ad22cf4f3d9 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:48.499660 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-688ff1e2-eeb5-43bd-9d3b-7ad22cf4f3d9 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:48.500152 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-688ff1e2-eeb5-43bd-9d3b-7ad22cf4f3d9 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:48.796156 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-688ff1e2-eeb5-43bd-9d3b-7ad22cf4f3d9 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:48.798843 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-48a302e8-2d67-4896-9508-ff0319bbccc5 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:48.805641 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-688ff1e2-eeb5-43bd-9d3b-7ad22cf4f3d9 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:48.807329 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-688ff1e2-eeb5-43bd-9d3b-7ad22cf4f3d9 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:48.807682 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-48a302e8-2d67-4896-9508-ff0319bbccc5 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1315 microversion: 2.1 time: 0.348000 Apr 15 19:52:48.808296 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 69/136] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:48 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:48.808471 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-688ff1e2-eeb5-43bd-9d3b-7ad22cf4f3d9 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1407 microversion: 2.20 time: 0.323070 Apr 15 19:52:48.809469 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 68/137] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:52:48 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1407 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:52:48.812940 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-4f43f3b9-eeb9-47be-84d4-d86f5b7de93e tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:48.814201 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-4f43f3b9-eeb9-47be-84d4-d86f5b7de93e tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:48.821596 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4f43f3b9-eeb9-47be-84d4-d86f5b7de93e tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:48.822096 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4f43f3b9-eeb9-47be-84d4-d86f5b7de93e tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:48.822918 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4f43f3b9-eeb9-47be-84d4-d86f5b7de93e tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:48.823426 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4f43f3b9-eeb9-47be-84d4-d86f5b7de93e tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:49.038128 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-4f43f3b9-eeb9-47be-84d4-d86f5b7de93e tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:49.046949 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-4f43f3b9-eeb9-47be-84d4-d86f5b7de93e tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1322 microversion: 2.1 time: 0.237651 Apr 15 19:52:49.047600 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 70/138] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:48 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:49.826106 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-871d1fc6-575a-4e91-9073-38645c05130c tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:49.826793 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-871d1fc6-575a-4e91-9073-38645c05130c tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:49.827759 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-03ae9e89-0596-413d-a939-ddd8594b55e0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:49.828430 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-03ae9e89-0596-413d-a939-ddd8594b55e0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:49.835454 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-871d1fc6-575a-4e91-9073-38645c05130c tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:49.836079 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-871d1fc6-575a-4e91-9073-38645c05130c tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:49.836797 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-03ae9e89-0596-413d-a939-ddd8594b55e0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:49.836922 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-871d1fc6-575a-4e91-9073-38645c05130c tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:49.837307 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-03ae9e89-0596-413d-a939-ddd8594b55e0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:49.837415 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-871d1fc6-575a-4e91-9073-38645c05130c tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:49.838144 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-03ae9e89-0596-413d-a939-ddd8594b55e0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:49.838637 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-03ae9e89-0596-413d-a939-ddd8594b55e0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:50.152578 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-871d1fc6-575a-4e91-9073-38645c05130c tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:50.157231 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-03ae9e89-0596-413d-a939-ddd8594b55e0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:50.162214 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-871d1fc6-575a-4e91-9073-38645c05130c tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1315 microversion: 2.1 time: 0.340200 Apr 15 19:52:50.162852 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 69/139] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:49 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:50.172068 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d8a58363-9c1d-4325-b9f4-39951bdb2fc8 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:50.172732 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d8a58363-9c1d-4325-b9f4-39951bdb2fc8 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:50.173187 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-03ae9e89-0596-413d-a939-ddd8594b55e0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:50.175461 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-03ae9e89-0596-413d-a939-ddd8594b55e0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:50.176623 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-03ae9e89-0596-413d-a939-ddd8594b55e0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1407 microversion: 2.20 time: 0.352908 Apr 15 19:52:50.177222 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 71/140] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:52:49 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1407 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:52:50.181067 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d8a58363-9c1d-4325-b9f4-39951bdb2fc8 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:50.181626 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d8a58363-9c1d-4325-b9f4-39951bdb2fc8 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:50.182450 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d8a58363-9c1d-4325-b9f4-39951bdb2fc8 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:50.182939 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d8a58363-9c1d-4325-b9f4-39951bdb2fc8 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:50.390725 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d8a58363-9c1d-4325-b9f4-39951bdb2fc8 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:50.399494 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d8a58363-9c1d-4325-b9f4-39951bdb2fc8 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1322 microversion: 2.1 time: 0.235576 Apr 15 19:52:50.400113 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 70/141] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:50 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:51.180271 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d5c85d64-dae6-4111-8ece-25b9f80e6a8e tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:51.180943 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d5c85d64-dae6-4111-8ece-25b9f80e6a8e tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:51.191973 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d5c85d64-dae6-4111-8ece-25b9f80e6a8e tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:51.192723 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d5c85d64-dae6-4111-8ece-25b9f80e6a8e tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:51.193767 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d5c85d64-dae6-4111-8ece-25b9f80e6a8e tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:51.194701 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d5c85d64-dae6-4111-8ece-25b9f80e6a8e tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:51.196614 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ea0805e4-fe67-4cec-9cf2-a2d90c157b83 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:51.197276 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ea0805e4-fe67-4cec-9cf2-a2d90c157b83 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:51.206551 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ea0805e4-fe67-4cec-9cf2-a2d90c157b83 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:51.207054 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ea0805e4-fe67-4cec-9cf2-a2d90c157b83 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:51.207921 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ea0805e4-fe67-4cec-9cf2-a2d90c157b83 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:51.208406 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ea0805e4-fe67-4cec-9cf2-a2d90c157b83 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:51.558079 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d5c85d64-dae6-4111-8ece-25b9f80e6a8e tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:51.562635 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ea0805e4-fe67-4cec-9cf2-a2d90c157b83 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:51.567520 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d5c85d64-dae6-4111-8ece-25b9f80e6a8e tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1315 microversion: 2.1 time: 0.391366 Apr 15 19:52:51.568152 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 72/142] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:51 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:51.572794 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ea11a4bf-5fb1-491e-b88e-1486e72303af tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:51.572927 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ea0805e4-fe67-4cec-9cf2-a2d90c157b83 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:51.573455 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ea11a4bf-5fb1-491e-b88e-1486e72303af tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:51.574493 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ea0805e4-fe67-4cec-9cf2-a2d90c157b83 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:51.575681 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ea0805e4-fe67-4cec-9cf2-a2d90c157b83 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1407 microversion: 2.20 time: 0.383797 Apr 15 19:52:51.576265 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 71/143] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:52:51 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1407 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:52:51.581187 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ea11a4bf-5fb1-491e-b88e-1486e72303af tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:51.581702 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ea11a4bf-5fb1-491e-b88e-1486e72303af tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:51.582762 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ea11a4bf-5fb1-491e-b88e-1486e72303af tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:51.583026 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ea11a4bf-5fb1-491e-b88e-1486e72303af tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:51.803186 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ea11a4bf-5fb1-491e-b88e-1486e72303af tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:51.811956 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ea11a4bf-5fb1-491e-b88e-1486e72303af tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1322 microversion: 2.1 time: 0.242775 Apr 15 19:52:51.812571 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 73/144] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:51 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:52.585767 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a5fa2399-4736-49b6-a353-995aba201515 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:52.586440 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a5fa2399-4736-49b6-a353-995aba201515 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:52.594386 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a5fa2399-4736-49b6-a353-995aba201515 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:52.594902 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a5fa2399-4736-49b6-a353-995aba201515 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:52.595992 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a5fa2399-4736-49b6-a353-995aba201515 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:52.596458 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a5fa2399-4736-49b6-a353-995aba201515 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:52.596858 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-71932ab8-8cfa-445f-b95f-c82bf9942d64 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:52.597825 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-71932ab8-8cfa-445f-b95f-c82bf9942d64 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:52.607430 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-71932ab8-8cfa-445f-b95f-c82bf9942d64 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:52.608096 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-71932ab8-8cfa-445f-b95f-c82bf9942d64 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:52.609644 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-71932ab8-8cfa-445f-b95f-c82bf9942d64 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:52.610363 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-71932ab8-8cfa-445f-b95f-c82bf9942d64 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:53.248728 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a5fa2399-4736-49b6-a353-995aba201515 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:53.275128 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a5fa2399-4736-49b6-a353-995aba201515 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1502 microversion: 2.1 time: 0.693358 Apr 15 19:52:53.275994 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 72/145] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:52 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1502 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:53.289833 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-71932ab8-8cfa-445f-b95f-c82bf9942d64 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:53.297690 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-cb8ea0db-c13d-4332-86b6-83b1b199ff08 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:53.298566 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-cb8ea0db-c13d-4332-86b6-83b1b199ff08 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:53.308507 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cb8ea0db-c13d-4332-86b6-83b1b199ff08 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:53.309476 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cb8ea0db-c13d-4332-86b6-83b1b199ff08 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:53.310990 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cb8ea0db-c13d-4332-86b6-83b1b199ff08 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:53.311958 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cb8ea0db-c13d-4332-86b6-83b1b199ff08 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:53.317823 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-71932ab8-8cfa-445f-b95f-c82bf9942d64 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:53.319809 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-71932ab8-8cfa-445f-b95f-c82bf9942d64 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:53.332577 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-71932ab8-8cfa-445f-b95f-c82bf9942d64 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1407 microversion: 2.20 time: 0.739498 Apr 15 19:52:53.333435 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 74/146] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:52:52 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1407 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:52:53.737491 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-cb8ea0db-c13d-4332-86b6-83b1b199ff08 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:53.750733 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-cb8ea0db-c13d-4332-86b6-83b1b199ff08 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1322 microversion: 2.1 time: 0.459439 Apr 15 19:52:53.751673 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 73/147] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:53 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1322 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:54.352043 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-68d04f68-74cb-4ce1-baf4-a2619487ab92 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:54.352805 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-68d04f68-74cb-4ce1-baf4-a2619487ab92 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:54.361127 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-68d04f68-74cb-4ce1-baf4-a2619487ab92 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:54.362260 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-68d04f68-74cb-4ce1-baf4-a2619487ab92 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:54.363098 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-68d04f68-74cb-4ce1-baf4-a2619487ab92 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:54.363666 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-68d04f68-74cb-4ce1-baf4-a2619487ab92 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:54.595072 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-68d04f68-74cb-4ce1-baf4-a2619487ab92 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:54.605640 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-68d04f68-74cb-4ce1-baf4-a2619487ab92 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:54.607450 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-68d04f68-74cb-4ce1-baf4-a2619487ab92 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:54.608602 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-68d04f68-74cb-4ce1-baf4-a2619487ab92 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1407 microversion: 2.20 time: 0.260900 Apr 15 19:52:54.609717 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 75/148] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:52:54 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:52:54.768203 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-56e771d5-ed61-47dd-969d-8e9e70c34a3c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:54.768797 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-56e771d5-ed61-47dd-969d-8e9e70c34a3c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:54.776612 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-56e771d5-ed61-47dd-969d-8e9e70c34a3c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:54.777116 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-56e771d5-ed61-47dd-969d-8e9e70c34a3c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:54.778037 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-56e771d5-ed61-47dd-969d-8e9e70c34a3c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:54.778694 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-56e771d5-ed61-47dd-969d-8e9e70c34a3c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:55.007758 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-56e771d5-ed61-47dd-969d-8e9e70c34a3c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:55.019711 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-56e771d5-ed61-47dd-969d-8e9e70c34a3c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1322 microversion: 2.1 time: 0.255394 Apr 15 19:52:55.024809 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 74/149] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:54 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:55.630566 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-aca64d24-6b38-4b85-bc81-1e59f0417882 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:55.631232 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-aca64d24-6b38-4b85-bc81-1e59f0417882 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:55.643945 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-aca64d24-6b38-4b85-bc81-1e59f0417882 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:55.644454 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-aca64d24-6b38-4b85-bc81-1e59f0417882 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:55.645310 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-aca64d24-6b38-4b85-bc81-1e59f0417882 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:55.645805 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-aca64d24-6b38-4b85-bc81-1e59f0417882 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:55.898935 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-aca64d24-6b38-4b85-bc81-1e59f0417882 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:55.908533 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-aca64d24-6b38-4b85-bc81-1e59f0417882 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:55.910281 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-aca64d24-6b38-4b85-bc81-1e59f0417882 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:55.911547 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-aca64d24-6b38-4b85-bc81-1e59f0417882 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1407 microversion: 2.20 time: 0.285442 Apr 15 19:52:55.912234 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 76/150] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:52:55 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1407 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:52:56.037560 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a00d95de-0cce-4bbc-bda2-f60dd770d7b4 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:56.038264 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a00d95de-0cce-4bbc-bda2-f60dd770d7b4 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:56.046894 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a00d95de-0cce-4bbc-bda2-f60dd770d7b4 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:56.046894 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a00d95de-0cce-4bbc-bda2-f60dd770d7b4 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:56.047772 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a00d95de-0cce-4bbc-bda2-f60dd770d7b4 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:56.048395 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a00d95de-0cce-4bbc-bda2-f60dd770d7b4 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:56.305593 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a00d95de-0cce-4bbc-bda2-f60dd770d7b4 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:56.314924 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a00d95de-0cce-4bbc-bda2-f60dd770d7b4 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1322 microversion: 2.1 time: 0.281335 Apr 15 19:52:56.315661 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 75/151] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:56 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1322 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:56.930469 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-91d5e12a-d49a-4933-a3aa-4e9ac6836ec0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:56.931978 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-91d5e12a-d49a-4933-a3aa-4e9ac6836ec0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:56.941468 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-91d5e12a-d49a-4933-a3aa-4e9ac6836ec0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:56.942293 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-91d5e12a-d49a-4933-a3aa-4e9ac6836ec0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:56.943378 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-91d5e12a-d49a-4933-a3aa-4e9ac6836ec0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:56.944201 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-91d5e12a-d49a-4933-a3aa-4e9ac6836ec0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:57.207166 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-91d5e12a-d49a-4933-a3aa-4e9ac6836ec0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:57.219510 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-91d5e12a-d49a-4933-a3aa-4e9ac6836ec0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:57.221217 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-91d5e12a-d49a-4933-a3aa-4e9ac6836ec0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:57.222394 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-91d5e12a-d49a-4933-a3aa-4e9ac6836ec0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1407 microversion: 2.20 time: 0.295923 Apr 15 19:52:57.223552 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 77/152] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:52:56 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1407 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:52:57.333176 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-5aac7bf4-c91c-422c-ac42-a3a89a4197ae tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:57.333929 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-5aac7bf4-c91c-422c-ac42-a3a89a4197ae tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:57.341720 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5aac7bf4-c91c-422c-ac42-a3a89a4197ae tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:57.342225 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5aac7bf4-c91c-422c-ac42-a3a89a4197ae tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:57.343067 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5aac7bf4-c91c-422c-ac42-a3a89a4197ae tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:57.343589 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5aac7bf4-c91c-422c-ac42-a3a89a4197ae tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:57.465135 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-247d0951-f51c-46c2-8ff8-a56b3bc96663 req-7d41b9f5-c4df-45d0-9e12-6f60975da994 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c5511dc-7635-490f-86b8-2a3c15d4d90e", "name": "network-vif-plugged", "status": "completed", "tag": "abc0c4ce-b998-4acc-9da8-075ad1fe41bd"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:52:57.467082 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:52:57.467082 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:52:57.477165 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-247d0951-f51c-46c2-8ff8-a56b3bc96663 req-7d41b9f5-c4df-45d0-9e12-6f60975da994 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:57.477744 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-247d0951-f51c-46c2-8ff8-a56b3bc96663 req-7d41b9f5-c4df-45d0-9e12-6f60975da994 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:57.496420 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-247d0951-f51c-46c2-8ff8-a56b3bc96663 req-7d41b9f5-c4df-45d0-9e12-6f60975da994 service nova] Creating event network-vif-plugged:abc0c4ce-b998-4acc-9da8-075ad1fe41bd for instance 3c5511dc-7635-490f-86b8-2a3c15d4d90e on hv-cinder-78638 Apr 15 19:52:57.501743 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-247d0951-f51c-46c2-8ff8-a56b3bc96663 req-7d41b9f5-c4df-45d0-9e12-6f60975da994 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041067 Apr 15 19:52:57.503237 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 78/153] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:52:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 15 19:52:57.559714 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-5aac7bf4-c91c-422c-ac42-a3a89a4197ae tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:57.569115 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-5aac7bf4-c91c-422c-ac42-a3a89a4197ae tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1322 microversion: 2.1 time: 0.240086 Apr 15 19:52:57.569733 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 76/154] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:57 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:58.242470 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-58415319-2f34-4862-aa02-b51d2886fdc0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:58.243219 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-58415319-2f34-4862-aa02-b51d2886fdc0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:58.251265 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-58415319-2f34-4862-aa02-b51d2886fdc0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:58.251819 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-58415319-2f34-4862-aa02-b51d2886fdc0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:58.252685 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-58415319-2f34-4862-aa02-b51d2886fdc0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:58.253176 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-58415319-2f34-4862-aa02-b51d2886fdc0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:58.467495 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-58415319-2f34-4862-aa02-b51d2886fdc0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:58.476953 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-58415319-2f34-4862-aa02-b51d2886fdc0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:58.478628 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-58415319-2f34-4862-aa02-b51d2886fdc0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:58.479824 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-58415319-2f34-4862-aa02-b51d2886fdc0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1407 microversion: 2.20 time: 0.241985 Apr 15 19:52:58.480434 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 79/155] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:52:58 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:52:58.587261 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-faabc559-e00d-4bf2-b041-79e4c9f4f40a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:58.587936 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-faabc559-e00d-4bf2-b041-79e4c9f4f40a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:58.595761 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-faabc559-e00d-4bf2-b041-79e4c9f4f40a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:58.596264 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-faabc559-e00d-4bf2-b041-79e4c9f4f40a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:58.597085 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-faabc559-e00d-4bf2-b041-79e4c9f4f40a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:58.597570 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-faabc559-e00d-4bf2-b041-79e4c9f4f40a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:58.808159 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-faabc559-e00d-4bf2-b041-79e4c9f4f40a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:58.817684 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-faabc559-e00d-4bf2-b041-79e4c9f4f40a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1322 microversion: 2.1 time: 0.234493 Apr 15 19:52:58.818272 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 77/156] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:58 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:52:59.498125 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-776742c7-6e17-4d45-9647-f1f476e2db29 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:59.498905 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-776742c7-6e17-4d45-9647-f1f476e2db29 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:59.506801 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-776742c7-6e17-4d45-9647-f1f476e2db29 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:59.507363 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-776742c7-6e17-4d45-9647-f1f476e2db29 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:59.508211 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-776742c7-6e17-4d45-9647-f1f476e2db29 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:59.508754 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-776742c7-6e17-4d45-9647-f1f476e2db29 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:59.724030 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-776742c7-6e17-4d45-9647-f1f476e2db29 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:59.733602 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-776742c7-6e17-4d45-9647-f1f476e2db29 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:59.735645 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-776742c7-6e17-4d45-9647-f1f476e2db29 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:52:59.736979 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-776742c7-6e17-4d45-9647-f1f476e2db29 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1407 microversion: 2.20 time: 0.242840 Apr 15 19:52:59.737870 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 80/157] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:52:59 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:52:59.834956 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-3cc3e5aa-109c-4369-b7d7-4bbd721e9a40 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:52:59.835778 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-3cc3e5aa-109c-4369-b7d7-4bbd721e9a40 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:52:59.843829 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3cc3e5aa-109c-4369-b7d7-4bbd721e9a40 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:59.844434 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3cc3e5aa-109c-4369-b7d7-4bbd721e9a40 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:52:59.845361 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3cc3e5aa-109c-4369-b7d7-4bbd721e9a40 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:52:59.846099 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3cc3e5aa-109c-4369-b7d7-4bbd721e9a40 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:00.150363 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3cc3e5aa-109c-4369-b7d7-4bbd721e9a40 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:00.159216 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-3cc3e5aa-109c-4369-b7d7-4bbd721e9a40 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1322 microversion: 2.1 time: 0.328866 Apr 15 19:53:00.159857 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 78/158] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:52:59 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1322 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:00.755993 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-21793749-e8c8-47d8-abd6-06e7d48c78f8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:00.756601 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-21793749-e8c8-47d8-abd6-06e7d48c78f8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:00.764313 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-21793749-e8c8-47d8-abd6-06e7d48c78f8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:00.764822 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-21793749-e8c8-47d8-abd6-06e7d48c78f8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:00.765645 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-21793749-e8c8-47d8-abd6-06e7d48c78f8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:00.766130 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-21793749-e8c8-47d8-abd6-06e7d48c78f8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:00.977952 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-21793749-e8c8-47d8-abd6-06e7d48c78f8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:00.987315 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-21793749-e8c8-47d8-abd6-06e7d48c78f8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:00.988995 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-21793749-e8c8-47d8-abd6-06e7d48c78f8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:00.990148 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-21793749-e8c8-47d8-abd6-06e7d48c78f8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1407 microversion: 2.20 time: 0.238356 Apr 15 19:53:00.990757 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 81/159] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:53:00 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1407 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:53:01.177267 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-2db7fbe4-808c-4ca8-8d0f-09a688087e14 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:01.178043 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-2db7fbe4-808c-4ca8-8d0f-09a688087e14 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:01.186163 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2db7fbe4-808c-4ca8-8d0f-09a688087e14 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:01.186665 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2db7fbe4-808c-4ca8-8d0f-09a688087e14 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:01.187571 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2db7fbe4-808c-4ca8-8d0f-09a688087e14 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:01.188058 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2db7fbe4-808c-4ca8-8d0f-09a688087e14 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:01.403142 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-2db7fbe4-808c-4ca8-8d0f-09a688087e14 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:01.412351 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-2db7fbe4-808c-4ca8-8d0f-09a688087e14 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1322 microversion: 2.1 time: 0.239059 Apr 15 19:53:01.412989 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 79/160] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:01 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:01.753940 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6e5c0ebd-c7e7-4b2f-a513-979e27bc124c tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3af9a45a-a7c3-4a7b-9857-6c1b5ebb02a8"}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:01.755226 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6e5c0ebd-c7e7-4b2f-a513-979e27bc124c tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:01.763014 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6e5c0ebd-c7e7-4b2f-a513-979e27bc124c tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:01.763573 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6e5c0ebd-c7e7-4b2f-a513-979e27bc124c tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:01.764337 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6e5c0ebd-c7e7-4b2f-a513-979e27bc124c tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:01.764824 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6e5c0ebd-c7e7-4b2f-a513-979e27bc124c tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:02.010174 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-53485762-9acd-48f0-a3ad-3e9d9301990e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:02.010839 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-53485762-9acd-48f0-a3ad-3e9d9301990e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:02.019480 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-53485762-9acd-48f0-a3ad-3e9d9301990e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:02.019989 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-53485762-9acd-48f0-a3ad-3e9d9301990e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:02.020823 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-53485762-9acd-48f0-a3ad-3e9d9301990e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:02.021311 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-53485762-9acd-48f0-a3ad-3e9d9301990e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:02.226689 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6e5c0ebd-c7e7-4b2f-a513-979e27bc124c tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "POST /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.477249 Apr 15 19:53:02.227876 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 82/161] 10.222.0.58 () {60 vars in 1313 bytes} [Thu Apr 15 19:53:01 2021] POST /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1/os-volume_attachments => generated 194 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:53:02.265502 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-53485762-9acd-48f0-a3ad-3e9d9301990e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:02.275850 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-53485762-9acd-48f0-a3ad-3e9d9301990e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:02.277701 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-53485762-9acd-48f0-a3ad-3e9d9301990e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:02.278856 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-53485762-9acd-48f0-a3ad-3e9d9301990e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1407 microversion: 2.20 time: 0.272788 Apr 15 19:53:02.292051 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 80/162] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:53:02 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1407 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 19:53:02.388981 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-246f6b4b-6748-423b-bfe4-6fb1e9eebf64 req-5a37a713-8885-4960-9a4b-097d80b1e0bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0ac4cf-7982-406b-a2f0-115ca5721a10", "name": "network-vif-plugged", "status": "completed", "tag": "431c18ae-c617-4e1e-bca6-7134661c98e1"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:02.391638 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:53:02.391638 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:53:02.403622 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-246f6b4b-6748-423b-bfe4-6fb1e9eebf64 req-5a37a713-8885-4960-9a4b-097d80b1e0bf service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:02.404126 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-246f6b4b-6748-423b-bfe4-6fb1e9eebf64 req-5a37a713-8885-4960-9a4b-097d80b1e0bf service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:02.422598 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-246f6b4b-6748-423b-bfe4-6fb1e9eebf64 req-5a37a713-8885-4960-9a4b-097d80b1e0bf service nova] Creating event network-vif-plugged:431c18ae-c617-4e1e-bca6-7134661c98e1 for instance 6c0ac4cf-7982-406b-a2f0-115ca5721a10 on hv-cinder-78638 Apr 15 19:53:02.430841 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d6df915a-9dcb-402f-ba36-ec8a84e90b77 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:02.431543 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d6df915a-9dcb-402f-ba36-ec8a84e90b77 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:02.437982 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-246f6b4b-6748-423b-bfe4-6fb1e9eebf64 req-5a37a713-8885-4960-9a4b-097d80b1e0bf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053376 Apr 15 19:53:02.438930 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 83/163] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:53:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:53:02.442331 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d6df915a-9dcb-402f-ba36-ec8a84e90b77 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:02.443072 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d6df915a-9dcb-402f-ba36-ec8a84e90b77 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:02.448502 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d6df915a-9dcb-402f-ba36-ec8a84e90b77 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:02.449111 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d6df915a-9dcb-402f-ba36-ec8a84e90b77 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:02.737148 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d6df915a-9dcb-402f-ba36-ec8a84e90b77 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:02.746031 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d6df915a-9dcb-402f-ba36-ec8a84e90b77 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1515 microversion: 2.1 time: 0.319216 Apr 15 19:53:02.746651 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 81/164] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:02 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1515 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:02.765309 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c188b37a-119d-467f-a7d5-6542ebc3af25 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:02.767002 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c188b37a-119d-467f-a7d5-6542ebc3af25 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:02.775457 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c188b37a-119d-467f-a7d5-6542ebc3af25 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:02.775967 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c188b37a-119d-467f-a7d5-6542ebc3af25 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:02.776786 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c188b37a-119d-467f-a7d5-6542ebc3af25 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:02.777264 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c188b37a-119d-467f-a7d5-6542ebc3af25 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:02.840879 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.objects.instance [None req-c188b37a-119d-467f-a7d5-6542ebc3af25 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lazy-loading 'flavor' on Instance uuid 3c5511dc-7635-490f-86b8-2a3c15d4d90e {{(pid=99512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 15 19:53:02.994780 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c188b37a-119d-467f-a7d5-6542ebc3af25 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "POST /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e/action" status: 200 len: 32 microversion: 2.1 time: 0.234410 Apr 15 19:53:02.995464 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 84/165] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:53:02 2021] POST /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e/action => generated 32 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 15 19:53:03.005344 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c9acdfb9-24b4-4bb9-a2b4-e86bcb5d54f1 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:03.006014 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c9acdfb9-24b4-4bb9-a2b4-e86bcb5d54f1 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:03.013932 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c9acdfb9-24b4-4bb9-a2b4-e86bcb5d54f1 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:03.014523 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c9acdfb9-24b4-4bb9-a2b4-e86bcb5d54f1 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:03.015384 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c9acdfb9-24b4-4bb9-a2b4-e86bcb5d54f1 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:03.015875 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c9acdfb9-24b4-4bb9-a2b4-e86bcb5d54f1 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:03.225870 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c9acdfb9-24b4-4bb9-a2b4-e86bcb5d54f1 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:03.234838 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c9acdfb9-24b4-4bb9-a2b4-e86bcb5d54f1 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1521 microversion: 2.1 time: 0.233889 Apr 15 19:53:03.235485 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 82/166] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:02 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:03.301017 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c60395fb-86e3-431d-98e2-bbd75d05f27c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:03.301774 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c60395fb-86e3-431d-98e2-bbd75d05f27c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:03.311468 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c60395fb-86e3-431d-98e2-bbd75d05f27c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:03.311955 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c60395fb-86e3-431d-98e2-bbd75d05f27c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:03.317167 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c60395fb-86e3-431d-98e2-bbd75d05f27c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:03.317699 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c60395fb-86e3-431d-98e2-bbd75d05f27c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:03.362992 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-69bd774e-502e-47f7-a7d1-ce18a6b6a93a tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1076411850", "imageRef": "10d66d6e-f687-4228-93d1-67502c9b42e2", "flavorRef": "452", "networks": [{"uuid": "3c5af1e6-577a-4a61-8cee-f71c73717efa"}]}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:03.451470 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.network.neutron [None req-69bd774e-502e-47f7-a7d1-ce18a6b6a93a tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] validate_networks() for [('3c5af1e6-577a-4a61-8cee-f71c73717efa', None, None, None)] {{(pid=99511) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 15 19:53:04.251762 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c60395fb-86e3-431d-98e2-bbd75d05f27c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:04.261445 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c60395fb-86e3-431d-98e2-bbd75d05f27c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:04.263147 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c60395fb-86e3-431d-98e2-bbd75d05f27c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:04.264652 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c60395fb-86e3-431d-98e2-bbd75d05f27c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1407 microversion: 2.20 time: 0.969674 Apr 15 19:53:04.265450 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 85/167] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:53:03 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1407 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:53:04.270897 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-83a2f53d-40b9-4f4e-a11d-8b4bc456bfaa tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:04.271807 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-83a2f53d-40b9-4f4e-a11d-8b4bc456bfaa tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:04.279793 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-83a2f53d-40b9-4f4e-a11d-8b4bc456bfaa tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:04.280382 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-83a2f53d-40b9-4f4e-a11d-8b4bc456bfaa tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:04.281302 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-83a2f53d-40b9-4f4e-a11d-8b4bc456bfaa tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:04.281995 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-83a2f53d-40b9-4f4e-a11d-8b4bc456bfaa tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:04.842400 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-83a2f53d-40b9-4f4e-a11d-8b4bc456bfaa tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:04.851482 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-83a2f53d-40b9-4f4e-a11d-8b4bc456bfaa tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1521 microversion: 2.1 time: 0.584718 Apr 15 19:53:04.852330 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 86/168] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:04 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1521 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:04.944744 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-69bd774e-502e-47f7-a7d1-ce18a6b6a93a tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Flavor limits 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 15 19:53:04.945238 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-69bd774e-502e-47f7-a7d1-ce18a6b6a93a tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Image limits 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 15 19:53:04.946255 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-69bd774e-502e-47f7-a7d1-ce18a6b6a93a tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Flavor pref 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 15 19:53:04.946715 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-69bd774e-502e-47f7-a7d1-ce18a6b6a93a tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Image pref 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 15 19:53:04.947171 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-69bd774e-502e-47f7-a7d1-ce18a6b6a93a tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 15 19:53:04.957208 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-69bd774e-502e-47f7-a7d1-ce18a6b6a93a tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:04.957708 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-69bd774e-502e-47f7-a7d1-ce18a6b6a93a tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:04.958575 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-69bd774e-502e-47f7-a7d1-ce18a6b6a93a tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:04.959061 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-69bd774e-502e-47f7-a7d1-ce18a6b6a93a tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:04.978699 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-69bd774e-502e-47f7-a7d1-ce18a6b6a93a tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Getting quotas for project 6584985c15cf4f69b1ece814924ddc62. Resources: {'cores', 'instances', 'ram'} {{(pid=99511) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 15 19:53:04.983842 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-69bd774e-502e-47f7-a7d1-ce18a6b6a93a tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Getting quotas for user ad166de2fea5478da2666ade77017cbf and project 6584985c15cf4f69b1ece814924ddc62. Resources: {'cores', 'instances', 'ram'} {{(pid=99511) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 15 19:53:04.996206 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-69bd774e-502e-47f7-a7d1-ce18a6b6a93a tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Going to run 1 instances... {{(pid=99511) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 15 19:53:04.998897 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-69bd774e-502e-47f7-a7d1-ce18a6b6a93a tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 574ff274-8b99-4baa-b424-16554e441853] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='10d66d6e-f687-4228-93d1-67502c9b42e2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 15 19:53:05.054272 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-69bd774e-502e-47f7-a7d1-ce18a6b6a93a tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.695193 Apr 15 19:53:05.054272 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 83/169] 10.222.0.58 () {60 vars in 1137 bytes} [Thu Apr 15 19:53:03 2021] POST /compute/v2.1/servers => generated 380 bytes in 1697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 15 19:53:05.065712 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-50e9d140-20eb-4734-b838-025e41a1c1aa tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:05.066380 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-50e9d140-20eb-4734-b838-025e41a1c1aa tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 574ff274-8b99-4baa-b424-16554e441853] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:05.151710 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-50e9d140-20eb-4734-b838-025e41a1c1aa tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad166de2fea5478da2666ade77017cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6584985c15cf4f69b1ece814924ddc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:05.161242 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-50e9d140-20eb-4734-b838-025e41a1c1aa tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853" status: 200 len: 1214 microversion: 2.1 time: 0.099954 Apr 15 19:53:05.161854 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 87/170] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:05 2021] GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853 => generated 1214 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:05.286181 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d639e65f-7f8c-4c7c-aa66-47120d41be56 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:05.286865 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d639e65f-7f8c-4c7c-aa66-47120d41be56 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:05.297948 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d639e65f-7f8c-4c7c-aa66-47120d41be56 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:05.298451 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d639e65f-7f8c-4c7c-aa66-47120d41be56 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:05.300714 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d639e65f-7f8c-4c7c-aa66-47120d41be56 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:05.301631 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d639e65f-7f8c-4c7c-aa66-47120d41be56 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:05.566539 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d639e65f-7f8c-4c7c-aa66-47120d41be56 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:05.575929 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d639e65f-7f8c-4c7c-aa66-47120d41be56 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:05.577603 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d639e65f-7f8c-4c7c-aa66-47120d41be56 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:05.578818 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d639e65f-7f8c-4c7c-aa66-47120d41be56 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1600 microversion: 2.20 time: 0.297334 Apr 15 19:53:05.579434 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 84/171] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:53:05 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1600 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:53:05.599259 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-1e7747ed-00c5-4254-af22-d2e5de04a949 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:05.599845 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-1e7747ed-00c5-4254-af22-d2e5de04a949 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:05.608862 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1e7747ed-00c5-4254-af22-d2e5de04a949 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:05.609369 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1e7747ed-00c5-4254-af22-d2e5de04a949 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:05.610211 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1e7747ed-00c5-4254-af22-d2e5de04a949 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:05.610705 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1e7747ed-00c5-4254-af22-d2e5de04a949 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:05.771374 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-1e7747ed-00c5-4254-af22-d2e5de04a949 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.176727 Apr 15 19:53:05.772107 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 88/172] 10.222.0.58 () {60 vars in 1306 bytes} [Thu Apr 15 19:53:05 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/os-interface => generated 285 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:53:05.870222 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-3a350991-6cec-4616-8c2e-d4ff2fbd9c10 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:05.870935 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-3a350991-6cec-4616-8c2e-d4ff2fbd9c10 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:05.879291 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3a350991-6cec-4616-8c2e-d4ff2fbd9c10 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:05.879805 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3a350991-6cec-4616-8c2e-d4ff2fbd9c10 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:05.880644 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3a350991-6cec-4616-8c2e-d4ff2fbd9c10 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:05.881137 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3a350991-6cec-4616-8c2e-d4ff2fbd9c10 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:06.179492 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-55f0a0f5-8c83-4728-8879-d8841bb6d121 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:06.180155 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-55f0a0f5-8c83-4728-8879-d8841bb6d121 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 574ff274-8b99-4baa-b424-16554e441853] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:06.188296 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-55f0a0f5-8c83-4728-8879-d8841bb6d121 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:06.188803 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-55f0a0f5-8c83-4728-8879-d8841bb6d121 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:06.190126 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-55f0a0f5-8c83-4728-8879-d8841bb6d121 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:06.190622 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-55f0a0f5-8c83-4728-8879-d8841bb6d121 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:06.339614 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-55f0a0f5-8c83-4728-8879-d8841bb6d121 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad166de2fea5478da2666ade77017cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6584985c15cf4f69b1ece814924ddc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:06.348265 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-55f0a0f5-8c83-4728-8879-d8841bb6d121 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853" status: 200 len: 1218 microversion: 2.1 time: 0.172826 Apr 15 19:53:06.348879 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 89/173] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:06 2021] GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853 => generated 1218 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:06.382207 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3a350991-6cec-4616-8c2e-d4ff2fbd9c10 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:06.391170 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-3a350991-6cec-4616-8c2e-d4ff2fbd9c10 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1521 microversion: 2.1 time: 0.525016 Apr 15 19:53:06.391927 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 85/174] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:05 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1521 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:07.366422 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6019fb73-c64b-4e0d-b613-f9c6f0300f72 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:07.367022 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6019fb73-c64b-4e0d-b613-f9c6f0300f72 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 574ff274-8b99-4baa-b424-16554e441853] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:07.374807 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6019fb73-c64b-4e0d-b613-f9c6f0300f72 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:07.375360 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6019fb73-c64b-4e0d-b613-f9c6f0300f72 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:07.376208 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6019fb73-c64b-4e0d-b613-f9c6f0300f72 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:07.377193 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6019fb73-c64b-4e0d-b613-f9c6f0300f72 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:07.409072 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9aeb0027-0a03-496c-b1c2-ad3b7762dffd tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:07.409745 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9aeb0027-0a03-496c-b1c2-ad3b7762dffd tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:07.418008 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9aeb0027-0a03-496c-b1c2-ad3b7762dffd tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:07.418750 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9aeb0027-0a03-496c-b1c2-ad3b7762dffd tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:07.419796 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9aeb0027-0a03-496c-b1c2-ad3b7762dffd tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:07.420459 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9aeb0027-0a03-496c-b1c2-ad3b7762dffd tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:07.593519 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-6019fb73-c64b-4e0d-b613-f9c6f0300f72 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad166de2fea5478da2666ade77017cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6584985c15cf4f69b1ece814924ddc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:07.602471 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6019fb73-c64b-4e0d-b613-f9c6f0300f72 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853" status: 200 len: 1218 microversion: 2.1 time: 0.240201 Apr 15 19:53:07.603103 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 90/175] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:07 2021] GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853 => generated 1218 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:07.872999 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9aeb0027-0a03-496c-b1c2-ad3b7762dffd tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:07.882595 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9aeb0027-0a03-496c-b1c2-ad3b7762dffd tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1521 microversion: 2.1 time: 0.477602 Apr 15 19:53:07.883154 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 86/176] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:07 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1521 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:07.969137 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9ca2b364-613c-40cc-bbde-51acbd7814c6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:07.970462 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9ca2b364-613c-40cc-bbde-51acbd7814c6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:07.973341 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-9ae6a283-6f6b-4b71-a1b7-6b05040a673c req-3cf8ad3f-2970-4884-8508-aeb144c579a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c0ac4cf-7982-406b-a2f0-115ca5721a10", "tag": "431c18ae-c617-4e1e-bca6-7134661c98e1"}]} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:07.975116 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:53:07.975116 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:53:07.979120 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9ca2b364-613c-40cc-bbde-51acbd7814c6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:07.979801 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9ca2b364-613c-40cc-bbde-51acbd7814c6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:07.980818 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9ca2b364-613c-40cc-bbde-51acbd7814c6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:07.981765 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9ca2b364-613c-40cc-bbde-51acbd7814c6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:07.984766 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-9ae6a283-6f6b-4b71-a1b7-6b05040a673c req-3cf8ad3f-2970-4884-8508-aeb144c579a1 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:07.985456 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-9ae6a283-6f6b-4b71-a1b7-6b05040a673c req-3cf8ad3f-2970-4884-8508-aeb144c579a1 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:08.008958 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-9ae6a283-6f6b-4b71-a1b7-6b05040a673c req-3cf8ad3f-2970-4884-8508-aeb144c579a1 service nova] Creating event network-changed:431c18ae-c617-4e1e-bca6-7134661c98e1 for instance 6c0ac4cf-7982-406b-a2f0-115ca5721a10 on hv-cinder-78638 Apr 15 19:53:08.014441 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-9ae6a283-6f6b-4b71-a1b7-6b05040a673c req-3cf8ad3f-2970-4884-8508-aeb144c579a1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045043 Apr 15 19:53:08.015914 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 87/177] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:53:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:53:08.621153 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-2dfe10e2-bb3c-4a95-9f12-788e6d0a0828 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:08.622091 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-2dfe10e2-bb3c-4a95-9f12-788e6d0a0828 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 574ff274-8b99-4baa-b424-16554e441853] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:08.630343 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2dfe10e2-bb3c-4a95-9f12-788e6d0a0828 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:08.630956 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2dfe10e2-bb3c-4a95-9f12-788e6d0a0828 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:08.631916 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2dfe10e2-bb3c-4a95-9f12-788e6d0a0828 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:08.632943 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2dfe10e2-bb3c-4a95-9f12-788e6d0a0828 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:08.766424 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-2dfe10e2-bb3c-4a95-9f12-788e6d0a0828 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad166de2fea5478da2666ade77017cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6584985c15cf4f69b1ece814924ddc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:08.775993 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-2dfe10e2-bb3c-4a95-9f12-788e6d0a0828 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853" status: 200 len: 1218 microversion: 2.1 time: 0.159439 Apr 15 19:53:08.776936 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 88/178] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:08 2021] GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853 => generated 1218 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:53:08.900320 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-dc77f992-44ef-4838-bec6-dd9f48260008 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:08.900988 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-dc77f992-44ef-4838-bec6-dd9f48260008 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:08.908851 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dc77f992-44ef-4838-bec6-dd9f48260008 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:08.909362 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dc77f992-44ef-4838-bec6-dd9f48260008 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:08.910193 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dc77f992-44ef-4838-bec6-dd9f48260008 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:08.910684 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dc77f992-44ef-4838-bec6-dd9f48260008 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:09.136153 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-dc77f992-44ef-4838-bec6-dd9f48260008 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:09.146011 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-dc77f992-44ef-4838-bec6-dd9f48260008 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1521 microversion: 2.1 time: 0.249756 Apr 15 19:53:09.146663 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 89/179] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:08 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:53:09.794389 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-4c5ffb2a-f82c-4e75-b579-711aae8799c4 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:09.795087 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-4c5ffb2a-f82c-4e75-b579-711aae8799c4 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 574ff274-8b99-4baa-b424-16554e441853] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:09.803549 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4c5ffb2a-f82c-4e75-b579-711aae8799c4 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:09.804058 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4c5ffb2a-f82c-4e75-b579-711aae8799c4 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:09.804926 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4c5ffb2a-f82c-4e75-b579-711aae8799c4 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:09.805415 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4c5ffb2a-f82c-4e75-b579-711aae8799c4 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:09.901882 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9ca2b364-613c-40cc-bbde-51acbd7814c6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 14 microversion: 2.20 time: 1.935959 Apr 15 19:53:09.906465 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 91/180] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:53:07 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 14 bytes in 1942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:09.980835 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-4c5ffb2a-f82c-4e75-b579-711aae8799c4 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad166de2fea5478da2666ade77017cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6584985c15cf4f69b1ece814924ddc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:09.990266 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-4c5ffb2a-f82c-4e75-b579-711aae8799c4 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853" status: 200 len: 1218 microversion: 2.1 time: 0.200126 Apr 15 19:53:09.990884 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 90/181] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:09 2021] GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853 => generated 1218 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:53:10.165177 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-66802bef-68c6-47ec-8c0d-ccba5bdda646 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:10.165946 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-66802bef-68c6-47ec-8c0d-ccba5bdda646 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:10.174890 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-66802bef-68c6-47ec-8c0d-ccba5bdda646 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:10.175428 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-66802bef-68c6-47ec-8c0d-ccba5bdda646 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:10.176274 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-66802bef-68c6-47ec-8c0d-ccba5bdda646 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:10.176773 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-66802bef-68c6-47ec-8c0d-ccba5bdda646 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:10.524327 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-66802bef-68c6-47ec-8c0d-ccba5bdda646 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:10.533465 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-66802bef-68c6-47ec-8c0d-ccba5bdda646 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1521 microversion: 2.1 time: 0.372869 Apr 15 19:53:10.543854 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 92/182] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:10 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1521 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:10.914219 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6b11d949-d347-4f2f-869b-ec8aac658f1f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:10.915370 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6b11d949-d347-4f2f-869b-ec8aac658f1f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:10.924228 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6b11d949-d347-4f2f-869b-ec8aac658f1f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:10.924743 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6b11d949-d347-4f2f-869b-ec8aac658f1f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:10.925589 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6b11d949-d347-4f2f-869b-ec8aac658f1f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:10.926081 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6b11d949-d347-4f2f-869b-ec8aac658f1f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:11.009424 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e4fdd3bd-2566-4d56-a9e1-71bfecad196e tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:11.010543 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e4fdd3bd-2566-4d56-a9e1-71bfecad196e tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 574ff274-8b99-4baa-b424-16554e441853] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:11.023073 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e4fdd3bd-2566-4d56-a9e1-71bfecad196e tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:11.027727 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e4fdd3bd-2566-4d56-a9e1-71bfecad196e tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:11.029097 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e4fdd3bd-2566-4d56-a9e1-71bfecad196e tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:11.030344 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e4fdd3bd-2566-4d56-a9e1-71bfecad196e tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:11.103923 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6b11d949-d347-4f2f-869b-ec8aac658f1f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 14 microversion: 2.20 time: 0.193568 Apr 15 19:53:11.104597 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 91/183] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:53:10 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 14 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:11.198593 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-e4fdd3bd-2566-4d56-a9e1-71bfecad196e tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad166de2fea5478da2666ade77017cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6584985c15cf4f69b1ece814924ddc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:11.207356 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e4fdd3bd-2566-4d56-a9e1-71bfecad196e tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853" status: 200 len: 1272 microversion: 2.1 time: 0.202246 Apr 15 19:53:11.207963 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 93/184] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:11 2021] GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853 => generated 1272 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:11.553089 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ba0d2d47-34d5-41ad-89b2-68f356a11c16 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:11.554001 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ba0d2d47-34d5-41ad-89b2-68f356a11c16 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:11.563821 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ba0d2d47-34d5-41ad-89b2-68f356a11c16 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:11.564974 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ba0d2d47-34d5-41ad-89b2-68f356a11c16 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:11.565861 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ba0d2d47-34d5-41ad-89b2-68f356a11c16 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:11.566520 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ba0d2d47-34d5-41ad-89b2-68f356a11c16 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:11.818051 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ba0d2d47-34d5-41ad-89b2-68f356a11c16 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:11.830960 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ba0d2d47-34d5-41ad-89b2-68f356a11c16 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1521 microversion: 2.1 time: 0.282905 Apr 15 19:53:11.831725 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 92/185] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:11 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:12.119440 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ba757638-638f-464e-b2e4-e2a21e5b4253 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:12.120491 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ba757638-638f-464e-b2e4-e2a21e5b4253 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:12.128515 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ba757638-638f-464e-b2e4-e2a21e5b4253 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:12.129028 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ba757638-638f-464e-b2e4-e2a21e5b4253 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:12.129869 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ba757638-638f-464e-b2e4-e2a21e5b4253 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:12.130366 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ba757638-638f-464e-b2e4-e2a21e5b4253 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:12.226347 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-db565460-6df6-4505-92cd-a5c7eae8e448 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:12.227048 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-db565460-6df6-4505-92cd-a5c7eae8e448 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 574ff274-8b99-4baa-b424-16554e441853] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:12.234833 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-db565460-6df6-4505-92cd-a5c7eae8e448 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:12.235363 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-db565460-6df6-4505-92cd-a5c7eae8e448 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:12.236189 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-db565460-6df6-4505-92cd-a5c7eae8e448 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:12.236671 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-db565460-6df6-4505-92cd-a5c7eae8e448 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:12.448507 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-db565460-6df6-4505-92cd-a5c7eae8e448 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad166de2fea5478da2666ade77017cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6584985c15cf4f69b1ece814924ddc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:12.457815 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-db565460-6df6-4505-92cd-a5c7eae8e448 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853" status: 200 len: 1314 microversion: 2.1 time: 0.235580 Apr 15 19:53:12.458417 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 93/186] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:12 2021] GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:53:12.848585 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6e5bed3b-2c14-4a86-b763-1f11a134a140 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:12.849392 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6e5bed3b-2c14-4a86-b763-1f11a134a140 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:12.857606 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6e5bed3b-2c14-4a86-b763-1f11a134a140 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:12.858116 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6e5bed3b-2c14-4a86-b763-1f11a134a140 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:12.858949 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6e5bed3b-2c14-4a86-b763-1f11a134a140 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:12.859470 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6e5bed3b-2c14-4a86-b763-1f11a134a140 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:13.069317 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-6e5bed3b-2c14-4a86-b763-1f11a134a140 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:13.078182 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6e5bed3b-2c14-4a86-b763-1f11a134a140 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1521 microversion: 2.1 time: 0.233618 Apr 15 19:53:13.078803 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 94/187] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:12 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:53:13.475714 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-cbbfbdb7-6e79-4cd7-9976-880f901c2105 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:13.476385 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-cbbfbdb7-6e79-4cd7-9976-880f901c2105 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 574ff274-8b99-4baa-b424-16554e441853] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:13.484160 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cbbfbdb7-6e79-4cd7-9976-880f901c2105 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:13.484660 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cbbfbdb7-6e79-4cd7-9976-880f901c2105 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:13.485493 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cbbfbdb7-6e79-4cd7-9976-880f901c2105 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:13.486589 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cbbfbdb7-6e79-4cd7-9976-880f901c2105 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:13.695837 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-cbbfbdb7-6e79-4cd7-9976-880f901c2105 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad166de2fea5478da2666ade77017cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6584985c15cf4f69b1ece814924ddc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:13.705286 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-cbbfbdb7-6e79-4cd7-9976-880f901c2105 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853" status: 200 len: 1314 microversion: 2.1 time: 0.233083 Apr 15 19:53:13.705896 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 95/188] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:13 2021] GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:53:14.096116 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d7e6d442-4c91-49ef-9af0-542c6cb10f19 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:14.096726 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d7e6d442-4c91-49ef-9af0-542c6cb10f19 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:14.104461 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d7e6d442-4c91-49ef-9af0-542c6cb10f19 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:14.104939 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d7e6d442-4c91-49ef-9af0-542c6cb10f19 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:14.105766 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d7e6d442-4c91-49ef-9af0-542c6cb10f19 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:14.106249 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d7e6d442-4c91-49ef-9af0-542c6cb10f19 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:14.324856 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d7e6d442-4c91-49ef-9af0-542c6cb10f19 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:14.334551 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d7e6d442-4c91-49ef-9af0-542c6cb10f19 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1521 microversion: 2.1 time: 0.242280 Apr 15 19:53:14.335011 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 96/189] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:14 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:53:14.723766 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-2365187b-392d-4198-a2f7-f9d36fe64663 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:14.724442 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-2365187b-392d-4198-a2f7-f9d36fe64663 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 574ff274-8b99-4baa-b424-16554e441853] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:14.732198 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2365187b-392d-4198-a2f7-f9d36fe64663 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:14.732707 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2365187b-392d-4198-a2f7-f9d36fe64663 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:14.733549 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2365187b-392d-4198-a2f7-f9d36fe64663 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:14.734039 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2365187b-392d-4198-a2f7-f9d36fe64663 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:14.954280 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-2365187b-392d-4198-a2f7-f9d36fe64663 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad166de2fea5478da2666ade77017cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6584985c15cf4f69b1ece814924ddc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:14.963997 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-2365187b-392d-4198-a2f7-f9d36fe64663 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853" status: 200 len: 1314 microversion: 2.1 time: 0.244555 Apr 15 19:53:14.964661 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 97/190] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:14 2021] GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:53:15.354288 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-2548b388-0df0-41f4-b712-72cdf86d4f14 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:15.354964 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-2548b388-0df0-41f4-b712-72cdf86d4f14 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:15.363299 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2548b388-0df0-41f4-b712-72cdf86d4f14 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:15.363815 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2548b388-0df0-41f4-b712-72cdf86d4f14 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:15.364661 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2548b388-0df0-41f4-b712-72cdf86d4f14 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:15.365150 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2548b388-0df0-41f4-b712-72cdf86d4f14 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:15.588089 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-2548b388-0df0-41f4-b712-72cdf86d4f14 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:15.597529 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-2548b388-0df0-41f4-b712-72cdf86d4f14 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1521 microversion: 2.1 time: 0.248785 Apr 15 19:53:15.598148 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 98/191] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:15 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:53:15.676247 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-d324f41a-b957-4378-b6b1-99d58e13cf16 req-346563e0-b8a4-4374-b9c2-3a77b68b1852 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "574ff274-8b99-4baa-b424-16554e441853", "tag": "a74c0278-5340-462f-a994-ad5e3c6fc1d8"}]} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:15.678300 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:53:15.678300 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:53:15.687876 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-d324f41a-b957-4378-b6b1-99d58e13cf16 req-346563e0-b8a4-4374-b9c2-3a77b68b1852 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:15.688270 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-d324f41a-b957-4378-b6b1-99d58e13cf16 req-346563e0-b8a4-4374-b9c2-3a77b68b1852 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:15.709250 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-d324f41a-b957-4378-b6b1-99d58e13cf16 req-346563e0-b8a4-4374-b9c2-3a77b68b1852 service nova] Creating event network-changed:a74c0278-5340-462f-a994-ad5e3c6fc1d8 for instance 574ff274-8b99-4baa-b424-16554e441853 on hv-cinder-78638 Apr 15 19:53:15.714841 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-d324f41a-b957-4378-b6b1-99d58e13cf16 req-346563e0-b8a4-4374-b9c2-3a77b68b1852 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042439 Apr 15 19:53:15.715682 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 99/192] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:53:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 15 19:53:15.943519 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ba757638-638f-464e-b2e4-e2a21e5b4253 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 14 microversion: 2.20 time: 3.831724 Apr 15 19:53:15.944389 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 94/193] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:53:12 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 14 bytes in 3834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:15.983189 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-14f53519-2929-4eaf-bc00-ecabf21534c3 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:15.983991 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-14f53519-2929-4eaf-bc00-ecabf21534c3 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 574ff274-8b99-4baa-b424-16554e441853] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:15.994706 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-14f53519-2929-4eaf-bc00-ecabf21534c3 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:15.995208 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-14f53519-2929-4eaf-bc00-ecabf21534c3 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:15.996068 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-14f53519-2929-4eaf-bc00-ecabf21534c3 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:15.996593 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-14f53519-2929-4eaf-bc00-ecabf21534c3 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:16.213925 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-14f53519-2929-4eaf-bc00-ecabf21534c3 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad166de2fea5478da2666ade77017cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6584985c15cf4f69b1ece814924ddc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:16.223540 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-14f53519-2929-4eaf-bc00-ecabf21534c3 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853" status: 200 len: 1314 microversion: 2.1 time: 0.244735 Apr 15 19:53:16.224165 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 100/194] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:15 2021] GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:16.616726 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-61c3ad48-b1ae-4449-a64e-7b330a4a99cd tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:16.617727 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-61c3ad48-b1ae-4449-a64e-7b330a4a99cd tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:16.627293 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-61c3ad48-b1ae-4449-a64e-7b330a4a99cd tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:16.627803 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-61c3ad48-b1ae-4449-a64e-7b330a4a99cd tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:16.629061 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-61c3ad48-b1ae-4449-a64e-7b330a4a99cd tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:16.629568 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-61c3ad48-b1ae-4449-a64e-7b330a4a99cd tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:16.844642 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-61c3ad48-b1ae-4449-a64e-7b330a4a99cd tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:16.853406 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-61c3ad48-b1ae-4449-a64e-7b330a4a99cd tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1521 microversion: 2.1 time: 0.241670 Apr 15 19:53:16.854038 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 95/195] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:16 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:16.958274 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-35cfe14e-862a-480b-822c-742c670733ca tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:16.960049 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-35cfe14e-862a-480b-822c-742c670733ca tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:16.968881 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-35cfe14e-862a-480b-822c-742c670733ca tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:16.969392 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-35cfe14e-862a-480b-822c-742c670733ca tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:16.970246 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-35cfe14e-862a-480b-822c-742c670733ca tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:16.970741 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-35cfe14e-862a-480b-822c-742c670733ca tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:17.123357 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-35cfe14e-862a-480b-822c-742c670733ca tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 14 microversion: 2.20 time: 0.170817 Apr 15 19:53:17.127352 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 101/196] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:53:16 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 14 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:17.241994 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a3b00b13-6d0f-45a1-aead-d0aa18e62c43 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:17.242658 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a3b00b13-6d0f-45a1-aead-d0aa18e62c43 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 574ff274-8b99-4baa-b424-16554e441853] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:17.250742 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a3b00b13-6d0f-45a1-aead-d0aa18e62c43 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:17.251179 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a3b00b13-6d0f-45a1-aead-d0aa18e62c43 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:17.252057 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a3b00b13-6d0f-45a1-aead-d0aa18e62c43 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:17.252543 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a3b00b13-6d0f-45a1-aead-d0aa18e62c43 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:17.469192 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a3b00b13-6d0f-45a1-aead-d0aa18e62c43 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad166de2fea5478da2666ade77017cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6584985c15cf4f69b1ece814924ddc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:17.478489 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a3b00b13-6d0f-45a1-aead-d0aa18e62c43 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853" status: 200 len: 1314 microversion: 2.1 time: 0.240685 Apr 15 19:53:17.479105 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 96/197] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:17 2021] GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:17.877499 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e3e2f0cf-8c89-479b-9696-6a761c657acc tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:17.879803 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e3e2f0cf-8c89-479b-9696-6a761c657acc tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:17.891841 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e3e2f0cf-8c89-479b-9696-6a761c657acc tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:17.892640 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e3e2f0cf-8c89-479b-9696-6a761c657acc tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:17.893702 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e3e2f0cf-8c89-479b-9696-6a761c657acc tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:17.894257 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e3e2f0cf-8c89-479b-9696-6a761c657acc tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:18.136865 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9acd3d01-51ed-493e-abee-1db3b1b6ce5e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:18.139696 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9acd3d01-51ed-493e-abee-1db3b1b6ce5e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:18.156510 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9acd3d01-51ed-493e-abee-1db3b1b6ce5e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:18.157003 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9acd3d01-51ed-493e-abee-1db3b1b6ce5e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:18.167898 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9acd3d01-51ed-493e-abee-1db3b1b6ce5e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:18.169094 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9acd3d01-51ed-493e-abee-1db3b1b6ce5e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:18.284436 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-e3e2f0cf-8c89-479b-9696-6a761c657acc tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:18.295621 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e3e2f0cf-8c89-479b-9696-6a761c657acc tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1521 microversion: 2.1 time: 0.425857 Apr 15 19:53:18.296463 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 102/198] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:17 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1521 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:18.322550 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9acd3d01-51ed-493e-abee-1db3b1b6ce5e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 14 microversion: 2.20 time: 0.190497 Apr 15 19:53:18.323368 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 97/199] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:53:18 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 14 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:18.496125 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f497731a-8a8f-4e0d-a2c4-abc289a857f0 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:18.496998 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f497731a-8a8f-4e0d-a2c4-abc289a857f0 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 574ff274-8b99-4baa-b424-16554e441853] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:18.506066 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f497731a-8a8f-4e0d-a2c4-abc289a857f0 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:18.506389 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f497731a-8a8f-4e0d-a2c4-abc289a857f0 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:18.507855 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f497731a-8a8f-4e0d-a2c4-abc289a857f0 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:18.508714 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f497731a-8a8f-4e0d-a2c4-abc289a857f0 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:18.852347 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f497731a-8a8f-4e0d-a2c4-abc289a857f0 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad166de2fea5478da2666ade77017cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6584985c15cf4f69b1ece814924ddc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:18.863771 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f497731a-8a8f-4e0d-a2c4-abc289a857f0 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853" status: 200 len: 1314 microversion: 2.1 time: 0.371473 Apr 15 19:53:18.864422 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 103/200] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:18 2021] GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853 => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:19.294249 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-cb6ca626-cfb5-4840-b102-38bb0eaff555 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:19.294904 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-cb6ca626-cfb5-4840-b102-38bb0eaff555 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:19.304143 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cb6ca626-cfb5-4840-b102-38bb0eaff555 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:19.304848 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cb6ca626-cfb5-4840-b102-38bb0eaff555 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:19.305827 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cb6ca626-cfb5-4840-b102-38bb0eaff555 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:19.306460 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cb6ca626-cfb5-4840-b102-38bb0eaff555 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:19.318136 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-fb9572f3-6336-4525-a682-53a3137e9b30 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:19.319079 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-fb9572f3-6336-4525-a682-53a3137e9b30 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:19.330327 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fb9572f3-6336-4525-a682-53a3137e9b30 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:19.331328 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fb9572f3-6336-4525-a682-53a3137e9b30 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:19.332694 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fb9572f3-6336-4525-a682-53a3137e9b30 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:19.333295 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fb9572f3-6336-4525-a682-53a3137e9b30 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:19.379346 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-cb6ca626-cfb5-4840-b102-38bb0eaff555 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Going to try to terminate instance {{(pid=99512) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 15 19:53:19.555919 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-cb6ca626-cfb5-4840-b102-38bb0eaff555 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "DELETE /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 204 len: 0 microversion: 2.1 time: 0.266189 Apr 15 19:53:19.556792 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 98/201] 10.222.0.58 () {58 vars in 1229 bytes} [Thu Apr 15 19:53:19 2021] DELETE /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 15 19:53:19.566211 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-750c889a-3b58-43e6-ad45-cc70619dd9d8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:19.567196 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-750c889a-3b58-43e6-ad45-cc70619dd9d8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:19.581553 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-750c889a-3b58-43e6-ad45-cc70619dd9d8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:19.582072 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-750c889a-3b58-43e6-ad45-cc70619dd9d8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:19.582932 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-750c889a-3b58-43e6-ad45-cc70619dd9d8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:19.583687 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-750c889a-3b58-43e6-ad45-cc70619dd9d8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:19.669558 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-fb9572f3-6336-4525-a682-53a3137e9b30 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:19.679082 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-fb9572f3-6336-4525-a682-53a3137e9b30 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1521 microversion: 2.1 time: 0.369435 Apr 15 19:53:19.679708 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 104/202] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:19 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1521 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:19.686220 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d90c4489-689b-4936-bdfc-9b32fe0fe18f tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:19.687297 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d90c4489-689b-4936-bdfc-9b32fe0fe18f tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:19.696608 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d90c4489-689b-4936-bdfc-9b32fe0fe18f tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:19.697309 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d90c4489-689b-4936-bdfc-9b32fe0fe18f tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:19.698795 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d90c4489-689b-4936-bdfc-9b32fe0fe18f tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:19.699267 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d90c4489-689b-4936-bdfc-9b32fe0fe18f tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:19.712951 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-750c889a-3b58-43e6-ad45-cc70619dd9d8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 14 microversion: 2.20 time: 0.148702 Apr 15 19:53:19.713718 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 99/203] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:53:19 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:19.884057 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-317217d3-3efd-44c2-9eac-259e2ba6b1e8 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:19.885156 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-317217d3-3efd-44c2-9eac-259e2ba6b1e8 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 574ff274-8b99-4baa-b424-16554e441853] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:19.895126 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-317217d3-3efd-44c2-9eac-259e2ba6b1e8 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:19.895755 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-317217d3-3efd-44c2-9eac-259e2ba6b1e8 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:19.896675 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-317217d3-3efd-44c2-9eac-259e2ba6b1e8 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:19.897221 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-317217d3-3efd-44c2-9eac-259e2ba6b1e8 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:19.945785 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d90c4489-689b-4936-bdfc-9b32fe0fe18f tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:19.956758 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d90c4489-689b-4936-bdfc-9b32fe0fe18f tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1554 microversion: 2.1 time: 0.275133 Apr 15 19:53:19.957793 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 105/204] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:19 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1554 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:20.158522 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-317217d3-3efd-44c2-9eac-259e2ba6b1e8 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad166de2fea5478da2666ade77017cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6584985c15cf4f69b1ece814924ddc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:20.167584 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-317217d3-3efd-44c2-9eac-259e2ba6b1e8 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853" status: 200 len: 1314 microversion: 2.1 time: 0.289361 Apr 15 19:53:20.178403 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 100/205] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:19 2021] GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:53:20.698125 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d9063fbf-3f91-4737-a211-848d95f657fb tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:20.698911 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d9063fbf-3f91-4737-a211-848d95f657fb tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:20.707680 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d9063fbf-3f91-4737-a211-848d95f657fb tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:20.708420 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d9063fbf-3f91-4737-a211-848d95f657fb tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:20.709441 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d9063fbf-3f91-4737-a211-848d95f657fb tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:20.710111 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d9063fbf-3f91-4737-a211-848d95f657fb tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:20.725562 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-4ce6a4bb-12b2-450f-bed7-4d10efb6ac78 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:20.726747 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-4ce6a4bb-12b2-450f-bed7-4d10efb6ac78 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:20.735348 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4ce6a4bb-12b2-450f-bed7-4d10efb6ac78 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:20.736179 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4ce6a4bb-12b2-450f-bed7-4d10efb6ac78 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:20.737292 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4ce6a4bb-12b2-450f-bed7-4d10efb6ac78 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:20.738106 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4ce6a4bb-12b2-450f-bed7-4d10efb6ac78 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:20.863428 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-4ce6a4bb-12b2-450f-bed7-4d10efb6ac78 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 14 microversion: 2.20 time: 0.142694 Apr 15 19:53:20.864505 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 101/206] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:53:20 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:20.968918 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d9063fbf-3f91-4737-a211-848d95f657fb tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:20.976462 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-aff09ffa-45c8-458a-93c8-2fa16053d8ae tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:20.977444 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-aff09ffa-45c8-458a-93c8-2fa16053d8ae tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:20.979693 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d9063fbf-3f91-4737-a211-848d95f657fb tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1521 microversion: 2.1 time: 0.285853 Apr 15 19:53:20.988709 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-aff09ffa-45c8-458a-93c8-2fa16053d8ae tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:20.989423 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-aff09ffa-45c8-458a-93c8-2fa16053d8ae tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:20.990423 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 106/207] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:20 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:20.992870 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-aff09ffa-45c8-458a-93c8-2fa16053d8ae tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:20.993394 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-aff09ffa-45c8-458a-93c8-2fa16053d8ae tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:21.185039 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-1d86c507-a17a-479a-a578-27f0cdd3897c tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:21.186366 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-1d86c507-a17a-479a-a578-27f0cdd3897c tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 574ff274-8b99-4baa-b424-16554e441853] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:21.196197 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1d86c507-a17a-479a-a578-27f0cdd3897c tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:21.197047 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1d86c507-a17a-479a-a578-27f0cdd3897c tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:21.198008 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1d86c507-a17a-479a-a578-27f0cdd3897c tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:21.198600 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1d86c507-a17a-479a-a578-27f0cdd3897c tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:21.392828 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-aff09ffa-45c8-458a-93c8-2fa16053d8ae tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:21.411597 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-aff09ffa-45c8-458a-93c8-2fa16053d8ae tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1554 microversion: 2.1 time: 0.438733 Apr 15 19:53:21.414114 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 102/208] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:20 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1554 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:53:21.499063 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-1d86c507-a17a-479a-a578-27f0cdd3897c tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad166de2fea5478da2666ade77017cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6584985c15cf4f69b1ece814924ddc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:21.508567 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-1d86c507-a17a-479a-a578-27f0cdd3897c tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853" status: 200 len: 1314 microversion: 2.1 time: 0.327712 Apr 15 19:53:21.509192 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 107/209] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:21 2021] GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853 => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:53:21.874567 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b90c33b6-e583-4e60-babb-1c416a04945d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:21.875723 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b90c33b6-e583-4e60-babb-1c416a04945d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:21.895939 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b90c33b6-e583-4e60-babb-1c416a04945d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:21.896555 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b90c33b6-e583-4e60-babb-1c416a04945d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:21.897298 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b90c33b6-e583-4e60-babb-1c416a04945d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:21.900682 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b90c33b6-e583-4e60-babb-1c416a04945d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:21.997925 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-bff07dfb-e5ae-4722-bd58-6ecf181c5d46 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:21.998733 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-bff07dfb-e5ae-4722-bd58-6ecf181c5d46 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:22.012634 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bff07dfb-e5ae-4722-bd58-6ecf181c5d46 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:22.013471 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bff07dfb-e5ae-4722-bd58-6ecf181c5d46 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:22.015874 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bff07dfb-e5ae-4722-bd58-6ecf181c5d46 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:22.016295 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bff07dfb-e5ae-4722-bd58-6ecf181c5d46 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:22.041265 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b90c33b6-e583-4e60-babb-1c416a04945d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 9137 microversion: 2.20 time: 0.170323 Apr 15 19:53:22.043520 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 103/210] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:53:21 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 9137 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 19:53:22.322336 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-bff07dfb-e5ae-4722-bd58-6ecf181c5d46 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:22.333340 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-bff07dfb-e5ae-4722-bd58-6ecf181c5d46 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1521 microversion: 2.1 time: 0.339772 Apr 15 19:53:22.341058 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 108/211] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:21 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:22.434147 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-0f99efc7-5bd3-42e6-afba-e8b8d9cf6e29 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:22.435437 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-0f99efc7-5bd3-42e6-afba-e8b8d9cf6e29 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:22.452702 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0f99efc7-5bd3-42e6-afba-e8b8d9cf6e29 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:22.453205 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0f99efc7-5bd3-42e6-afba-e8b8d9cf6e29 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:22.454026 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0f99efc7-5bd3-42e6-afba-e8b8d9cf6e29 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:22.455245 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0f99efc7-5bd3-42e6-afba-e8b8d9cf6e29 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:22.526133 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-62c3baa3-09d8-4a29-8ba0-596f8e168f69 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:22.527118 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-62c3baa3-09d8-4a29-8ba0-596f8e168f69 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 574ff274-8b99-4baa-b424-16554e441853] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:22.541596 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-62c3baa3-09d8-4a29-8ba0-596f8e168f69 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:22.546748 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-62c3baa3-09d8-4a29-8ba0-596f8e168f69 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:22.547970 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-62c3baa3-09d8-4a29-8ba0-596f8e168f69 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:22.548717 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-62c3baa3-09d8-4a29-8ba0-596f8e168f69 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:22.787951 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-0f99efc7-5bd3-42e6-afba-e8b8d9cf6e29 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:22.808556 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-0f99efc7-5bd3-42e6-afba-e8b8d9cf6e29 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1554 microversion: 2.1 time: 0.380065 Apr 15 19:53:22.819402 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 104/212] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:22 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1554 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:22.975803 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-62c3baa3-09d8-4a29-8ba0-596f8e168f69 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad166de2fea5478da2666ade77017cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6584985c15cf4f69b1ece814924ddc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:22.989236 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-62c3baa3-09d8-4a29-8ba0-596f8e168f69 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853" status: 200 len: 1314 microversion: 2.1 time: 0.466733 Apr 15 19:53:22.989625 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 109/213] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:22 2021] GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853 => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:23.055012 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-807b952d-5515-42c7-80a2-e91f96b890b1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:23.056090 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-807b952d-5515-42c7-80a2-e91f96b890b1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:23.070081 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-807b952d-5515-42c7-80a2-e91f96b890b1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:23.070577 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-807b952d-5515-42c7-80a2-e91f96b890b1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:23.076347 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-807b952d-5515-42c7-80a2-e91f96b890b1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:23.076854 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-807b952d-5515-42c7-80a2-e91f96b890b1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:23.228236 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-807b952d-5515-42c7-80a2-e91f96b890b1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 15480 microversion: 2.20 time: 0.177956 Apr 15 19:53:23.229798 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 105/214] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:53:23 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 15480 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:53:23.351904 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f2a81830-adfa-4bd9-bf50-aa1a939d5dae tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:23.352836 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f2a81830-adfa-4bd9-bf50-aa1a939d5dae tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:23.364172 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f2a81830-adfa-4bd9-bf50-aa1a939d5dae tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:23.364675 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f2a81830-adfa-4bd9-bf50-aa1a939d5dae tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:23.366035 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f2a81830-adfa-4bd9-bf50-aa1a939d5dae tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:23.366690 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f2a81830-adfa-4bd9-bf50-aa1a939d5dae tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:23.787070 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f2a81830-adfa-4bd9-bf50-aa1a939d5dae tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:23.801357 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f2a81830-adfa-4bd9-bf50-aa1a939d5dae tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1521 microversion: 2.1 time: 0.454361 Apr 15 19:53:23.803515 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 110/215] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:23 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1521 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:23.828244 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7dbb43c7-8e7e-4ebd-9541-034bc784042f tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:23.829247 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7dbb43c7-8e7e-4ebd-9541-034bc784042f tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:23.838241 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7dbb43c7-8e7e-4ebd-9541-034bc784042f tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:23.838954 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7dbb43c7-8e7e-4ebd-9541-034bc784042f tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:23.840044 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7dbb43c7-8e7e-4ebd-9541-034bc784042f tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:23.840685 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7dbb43c7-8e7e-4ebd-9541-034bc784042f tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:23.916895 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-9a50a0ad-4ede-4fba-9705-56269899d4d8 req-4e11ae6b-f715-4ca1-b808-35e02c643b97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfcb0ac4-3cef-44ba-8766-5fa9259164f1", "name": "network-vif-deleted", "tag": "27ea1896-c589-442b-9fb0-deb3ed55cb4a"}]} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:23.919520 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:53:23.919520 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:53:23.944486 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-9a50a0ad-4ede-4fba-9705-56269899d4d8 req-4e11ae6b-f715-4ca1-b808-35e02c643b97 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:23.945236 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-9a50a0ad-4ede-4fba-9705-56269899d4d8 req-4e11ae6b-f715-4ca1-b808-35e02c643b97 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:23.981135 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-9a50a0ad-4ede-4fba-9705-56269899d4d8 req-4e11ae6b-f715-4ca1-b808-35e02c643b97 service nova] Creating event network-vif-deleted:27ea1896-c589-442b-9fb0-deb3ed55cb4a for instance dfcb0ac4-3cef-44ba-8766-5fa9259164f1 on hv-cinder-78638 Apr 15 19:53:23.988117 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-9a50a0ad-4ede-4fba-9705-56269899d4d8 req-4e11ae6b-f715-4ca1-b808-35e02c643b97 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075724 Apr 15 19:53:23.989018 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 111/216] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:53:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:53:24.007421 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-228db72e-fb30-4f9a-bc93-6fb4a044bee2 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:24.008335 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-228db72e-fb30-4f9a-bc93-6fb4a044bee2 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 574ff274-8b99-4baa-b424-16554e441853] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:24.036174 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-228db72e-fb30-4f9a-bc93-6fb4a044bee2 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:24.036630 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-228db72e-fb30-4f9a-bc93-6fb4a044bee2 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:24.037482 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-228db72e-fb30-4f9a-bc93-6fb4a044bee2 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:24.037977 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-228db72e-fb30-4f9a-bc93-6fb4a044bee2 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:24.119661 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-7dbb43c7-8e7e-4ebd-9541-034bc784042f tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:24.130144 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7dbb43c7-8e7e-4ebd-9541-034bc784042f tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1512 microversion: 2.1 time: 0.306697 Apr 15 19:53:24.133532 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 106/217] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:23 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1512 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:24.242446 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-5be4da70-345e-401b-aa78-a9f198b99a56 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:24.243746 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-5be4da70-345e-401b-aa78-a9f198b99a56 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:24.253485 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5be4da70-345e-401b-aa78-a9f198b99a56 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:24.254429 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5be4da70-345e-401b-aa78-a9f198b99a56 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:24.255590 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5be4da70-345e-401b-aa78-a9f198b99a56 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:24.256205 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5be4da70-345e-401b-aa78-a9f198b99a56 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:24.389006 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-228db72e-fb30-4f9a-bc93-6fb4a044bee2 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad166de2fea5478da2666ade77017cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6584985c15cf4f69b1ece814924ddc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:24.401905 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-228db72e-fb30-4f9a-bc93-6fb4a044bee2 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853" status: 200 len: 1314 microversion: 2.1 time: 0.398853 Apr 15 19:53:24.402729 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 112/218] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:24 2021] GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853 => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:53:24.404875 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-5be4da70-345e-401b-aa78-a9f198b99a56 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 17744 microversion: 2.20 time: 0.167135 Apr 15 19:53:24.409467 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 107/219] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:53:24 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 17744 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:53:24.605184 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-8af94401-ae9b-4e00-9e19-09105c8c33fe req-f130172b-bbb7-45f5-825e-c777f49d2f11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "574ff274-8b99-4baa-b424-16554e441853", "name": "network-vif-plugged", "status": "completed", "tag": "a74c0278-5340-462f-a994-ad5e3c6fc1d8"}]} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:24.607887 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:53:24.607887 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:53:24.638725 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-8af94401-ae9b-4e00-9e19-09105c8c33fe req-f130172b-bbb7-45f5-825e-c777f49d2f11 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:24.640474 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-8af94401-ae9b-4e00-9e19-09105c8c33fe req-f130172b-bbb7-45f5-825e-c777f49d2f11 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:24.663820 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-8af94401-ae9b-4e00-9e19-09105c8c33fe req-f130172b-bbb7-45f5-825e-c777f49d2f11 service nova] Creating event network-vif-plugged:a74c0278-5340-462f-a994-ad5e3c6fc1d8 for instance 574ff274-8b99-4baa-b424-16554e441853 on hv-cinder-78638 Apr 15 19:53:24.686740 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-8af94401-ae9b-4e00-9e19-09105c8c33fe req-f130172b-bbb7-45f5-825e-c777f49d2f11 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087308 Apr 15 19:53:24.687375 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 113/220] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:53:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:53:24.821904 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-5f98790c-a01e-42cf-8095-7d9f1dddcb99 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:24.823041 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-5f98790c-a01e-42cf-8095-7d9f1dddcb99 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:24.840713 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5f98790c-a01e-42cf-8095-7d9f1dddcb99 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:24.841200 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5f98790c-a01e-42cf-8095-7d9f1dddcb99 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:24.842054 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5f98790c-a01e-42cf-8095-7d9f1dddcb99 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:24.842552 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5f98790c-a01e-42cf-8095-7d9f1dddcb99 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:25.151751 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9a0c0586-6beb-4620-a1ab-22808e2a7870 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:25.155811 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9a0c0586-6beb-4620-a1ab-22808e2a7870 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:25.165046 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9a0c0586-6beb-4620-a1ab-22808e2a7870 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:25.165558 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9a0c0586-6beb-4620-a1ab-22808e2a7870 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:25.166432 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9a0c0586-6beb-4620-a1ab-22808e2a7870 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:25.170571 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9a0c0586-6beb-4620-a1ab-22808e2a7870 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:25.214324 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-5f98790c-a01e-42cf-8095-7d9f1dddcb99 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:25.224597 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-5f98790c-a01e-42cf-8095-7d9f1dddcb99 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1521 microversion: 2.1 time: 0.406976 Apr 15 19:53:25.225219 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 108/221] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:24 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1521 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:25.311832 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9a0c0586-6beb-4620-a1ab-22808e2a7870 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246785b33b504bebbf6b59e4d8f129fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a86c89f03e548cdb2f0fc7c1af2ea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:25.322661 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9a0c0586-6beb-4620-a1ab-22808e2a7870 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 200 len: 1346 microversion: 2.1 time: 0.175367 Apr 15 19:53:25.323563 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 114/222] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:25 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 1346 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:53:25.418698 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-3c638b12-efe2-4b58-ae4d-158764fe44d7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:25.419745 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-3c638b12-efe2-4b58-ae4d-158764fe44d7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:25.421275 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f1a1baaf-1abb-4570-b309-c3985ae7e39d tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:25.422019 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f1a1baaf-1abb-4570-b309-c3985ae7e39d tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 574ff274-8b99-4baa-b424-16554e441853] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:25.430441 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f1a1baaf-1abb-4570-b309-c3985ae7e39d tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:25.431124 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f1a1baaf-1abb-4570-b309-c3985ae7e39d tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:25.433105 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3c638b12-efe2-4b58-ae4d-158764fe44d7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:25.433105 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3c638b12-efe2-4b58-ae4d-158764fe44d7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:25.433105 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3c638b12-efe2-4b58-ae4d-158764fe44d7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:25.433575 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3c638b12-efe2-4b58-ae4d-158764fe44d7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:25.434553 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f1a1baaf-1abb-4570-b309-c3985ae7e39d tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:25.435231 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f1a1baaf-1abb-4570-b309-c3985ae7e39d tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:25.609082 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-3c638b12-efe2-4b58-ae4d-158764fe44d7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 19618 microversion: 2.20 time: 0.194784 Apr 15 19:53:25.610477 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 109/223] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:53:25 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 19618 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:53:25.690901 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f1a1baaf-1abb-4570-b309-c3985ae7e39d tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad166de2fea5478da2666ade77017cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6584985c15cf4f69b1ece814924ddc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:25.702278 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f1a1baaf-1abb-4570-b309-c3985ae7e39d tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853" status: 200 len: 1314 microversion: 2.1 time: 0.285884 Apr 15 19:53:25.702919 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 115/224] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:25 2021] GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:26.243785 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-364fcdb2-4991-4967-84ad-3d852c9753a2 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:26.244528 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-364fcdb2-4991-4967-84ad-3d852c9753a2 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:26.253735 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-364fcdb2-4991-4967-84ad-3d852c9753a2 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:26.254503 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-364fcdb2-4991-4967-84ad-3d852c9753a2 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:26.255581 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-364fcdb2-4991-4967-84ad-3d852c9753a2 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:26.256270 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-364fcdb2-4991-4967-84ad-3d852c9753a2 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:26.342006 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b21f276b-1dcd-4a71-b433-8b7cd3dbd3f8 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:26.343120 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b21f276b-1dcd-4a71-b433-8b7cd3dbd3f8 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:26.353697 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b21f276b-1dcd-4a71-b433-8b7cd3dbd3f8 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:26.354636 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b21f276b-1dcd-4a71-b433-8b7cd3dbd3f8 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:26.356300 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b21f276b-1dcd-4a71-b433-8b7cd3dbd3f8 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:26.356945 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b21f276b-1dcd-4a71-b433-8b7cd3dbd3f8 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:26.472581 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-b21f276b-1dcd-4a71-b433-8b7cd3dbd3f8 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] HTTP exception thrown: Instance dfcb0ac4-3cef-44ba-8766-5fa9259164f1 could not be found. Apr 15 19:53:26.495053 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b21f276b-1dcd-4a71-b433-8b7cd3dbd3f8 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Returning 404 to user: Instance dfcb0ac4-3cef-44ba-8766-5fa9259164f1 could not be found. {{(pid=99511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 19:53:26.496566 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b21f276b-1dcd-4a71-b433-8b7cd3dbd3f8 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 404 len: 111 microversion: 2.1 time: 0.159081 Apr 15 19:53:26.502116 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 116/225] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:26 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 15 19:53:26.535890 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-364fcdb2-4991-4967-84ad-3d852c9753a2 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:26.547174 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-364fcdb2-4991-4967-84ad-3d852c9753a2 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1521 microversion: 2.1 time: 0.307975 Apr 15 19:53:26.549095 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 110/226] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:26 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:26.622837 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9c002841-50fa-4e6e-bbce-696def636b88 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:26.624963 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9c002841-50fa-4e6e-bbce-696def636b88 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:26.650686 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9c002841-50fa-4e6e-bbce-696def636b88 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:26.653478 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9c002841-50fa-4e6e-bbce-696def636b88 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:26.654386 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9c002841-50fa-4e6e-bbce-696def636b88 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:26.654886 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9c002841-50fa-4e6e-bbce-696def636b88 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:26.721332 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-372414c8-44cf-4fd6-8a56-83c0e9aee4ba tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:26.722114 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-372414c8-44cf-4fd6-8a56-83c0e9aee4ba tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 574ff274-8b99-4baa-b424-16554e441853] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:26.744567 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-372414c8-44cf-4fd6-8a56-83c0e9aee4ba tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:26.745847 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-372414c8-44cf-4fd6-8a56-83c0e9aee4ba tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:26.747552 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-372414c8-44cf-4fd6-8a56-83c0e9aee4ba tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:26.749610 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-372414c8-44cf-4fd6-8a56-83c0e9aee4ba tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:26.798986 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9c002841-50fa-4e6e-bbce-696def636b88 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 21935 microversion: 2.20 time: 0.180441 Apr 15 19:53:26.800445 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 117/227] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:53:26 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 21935 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:53:27.058795 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-372414c8-44cf-4fd6-8a56-83c0e9aee4ba tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad166de2fea5478da2666ade77017cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6584985c15cf4f69b1ece814924ddc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:27.069530 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-372414c8-44cf-4fd6-8a56-83c0e9aee4ba tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853" status: 200 len: 1498 microversion: 2.1 time: 0.353033 Apr 15 19:53:27.070350 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 111/228] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:26 2021] GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853 => generated 1498 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:27.567253 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-60d2bb1c-1d2a-4be3-bb68-58199bc3fa6b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:27.568048 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-60d2bb1c-1d2a-4be3-bb68-58199bc3fa6b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:27.582082 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-60d2bb1c-1d2a-4be3-bb68-58199bc3fa6b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:27.582594 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-60d2bb1c-1d2a-4be3-bb68-58199bc3fa6b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:27.583622 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-60d2bb1c-1d2a-4be3-bb68-58199bc3fa6b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:27.584128 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-60d2bb1c-1d2a-4be3-bb68-58199bc3fa6b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:27.810781 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-fa1622dc-9475-4f6a-bed5-d84145a0c314 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:27.811956 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-fa1622dc-9475-4f6a-bed5-d84145a0c314 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:27.822476 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fa1622dc-9475-4f6a-bed5-d84145a0c314 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:27.823175 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fa1622dc-9475-4f6a-bed5-d84145a0c314 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:27.824047 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fa1622dc-9475-4f6a-bed5-d84145a0c314 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:27.824539 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fa1622dc-9475-4f6a-bed5-d84145a0c314 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:27.874000 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-60d2bb1c-1d2a-4be3-bb68-58199bc3fa6b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:27.888430 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-60d2bb1c-1d2a-4be3-bb68-58199bc3fa6b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1521 microversion: 2.1 time: 0.326325 Apr 15 19:53:27.899006 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 118/229] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:27 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1521 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:27.959001 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-fa1622dc-9475-4f6a-bed5-d84145a0c314 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 23227 microversion: 2.20 time: 0.152105 Apr 15 19:53:27.963416 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 112/230] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:53:27 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 23227 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:53:28.415572 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-0513af5b-9699-4282-ac82-5f555febb075 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:28.416386 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-0513af5b-9699-4282-ac82-5f555febb075 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 574ff274-8b99-4baa-b424-16554e441853] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:28.426336 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0513af5b-9699-4282-ac82-5f555febb075 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:28.427577 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0513af5b-9699-4282-ac82-5f555febb075 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:28.428608 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0513af5b-9699-4282-ac82-5f555febb075 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:28.429246 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0513af5b-9699-4282-ac82-5f555febb075 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:28.515259 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-0513af5b-9699-4282-ac82-5f555febb075 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 574ff274-8b99-4baa-b424-16554e441853] Going to try to terminate instance {{(pid=99511) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 15 19:53:28.680241 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-0513af5b-9699-4282-ac82-5f555febb075 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "DELETE /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853" status: 204 len: 0 microversion: 2.1 time: 0.270148 Apr 15 19:53:28.685256 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 119/231] 10.222.0.58 () {58 vars in 1229 bytes} [Thu Apr 15 19:53:28 2021] DELETE /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 15 19:53:28.691700 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-feb29ca1-70b8-4469-a95f-caf7c0e3abef tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:28.692467 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-feb29ca1-70b8-4469-a95f-caf7c0e3abef tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 574ff274-8b99-4baa-b424-16554e441853] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:28.708523 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-feb29ca1-70b8-4469-a95f-caf7c0e3abef tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:28.709037 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-feb29ca1-70b8-4469-a95f-caf7c0e3abef tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:28.709912 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-feb29ca1-70b8-4469-a95f-caf7c0e3abef tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:28.720924 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-feb29ca1-70b8-4469-a95f-caf7c0e3abef tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:28.722829 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9187410f-c2cb-4ef4-b001-93ee5b068064 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:28.723743 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9187410f-c2cb-4ef4-b001-93ee5b068064 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:28.738246 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9187410f-c2cb-4ef4-b001-93ee5b068064 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:28.740421 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9187410f-c2cb-4ef4-b001-93ee5b068064 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:28.741370 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9187410f-c2cb-4ef4-b001-93ee5b068064 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:28.743797 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9187410f-c2cb-4ef4-b001-93ee5b068064 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:28.813828 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-9187410f-c2cb-4ef4-b001-93ee5b068064 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] HTTP exception thrown: Instance dfcb0ac4-3cef-44ba-8766-5fa9259164f1 could not be found. Apr 15 19:53:28.814747 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9187410f-c2cb-4ef4-b001-93ee5b068064 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Returning 404 to user: Instance dfcb0ac4-3cef-44ba-8766-5fa9259164f1 could not be found. {{(pid=99511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 19:53:28.815850 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9187410f-c2cb-4ef4-b001-93ee5b068064 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "DELETE /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 404 len: 111 microversion: 2.1 time: 0.098724 Apr 15 19:53:28.816899 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 120/232] 10.222.0.58 () {58 vars in 1229 bytes} [Thu Apr 15 19:53:28 2021] DELETE /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 15 19:53:28.826900 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c2fafcc7-56e0-4b1b-be71-5ca0f555c896 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:28.827786 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c2fafcc7-56e0-4b1b-be71-5ca0f555c896 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] [instance: dfcb0ac4-3cef-44ba-8766-5fa9259164f1] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:28.836737 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c2fafcc7-56e0-4b1b-be71-5ca0f555c896 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:28.837445 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c2fafcc7-56e0-4b1b-be71-5ca0f555c896 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:28.838460 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c2fafcc7-56e0-4b1b-be71-5ca0f555c896 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:28.839094 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c2fafcc7-56e0-4b1b-be71-5ca0f555c896 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:28.926332 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-c2fafcc7-56e0-4b1b-be71-5ca0f555c896 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] HTTP exception thrown: Instance dfcb0ac4-3cef-44ba-8766-5fa9259164f1 could not be found. Apr 15 19:53:28.927084 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c2fafcc7-56e0-4b1b-be71-5ca0f555c896 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] Returning 404 to user: Instance dfcb0ac4-3cef-44ba-8766-5fa9259164f1 could not be found. {{(pid=99511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 19:53:28.928080 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c2fafcc7-56e0-4b1b-be71-5ca0f555c896 tempest-DeleteServersTestJSON-1874427622 tempest-DeleteServersTestJSON-1874427622-project] 10.222.0.58 "GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1" status: 404 len: 111 microversion: 2.1 time: 0.106431 Apr 15 19:53:28.928899 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 121/233] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:28 2021] GET /compute/v2.1/servers/dfcb0ac4-3cef-44ba-8766-5fa9259164f1 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 15 19:53:28.946622 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-325be16f-8cb3-4508-b9bc-25c5baa6ae8f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:28.947388 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-325be16f-8cb3-4508-b9bc-25c5baa6ae8f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:28.968864 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-325be16f-8cb3-4508-b9bc-25c5baa6ae8f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:28.968864 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-325be16f-8cb3-4508-b9bc-25c5baa6ae8f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:28.970359 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-325be16f-8cb3-4508-b9bc-25c5baa6ae8f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:28.970869 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-325be16f-8cb3-4508-b9bc-25c5baa6ae8f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:29.069864 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-feb29ca1-70b8-4469-a95f-caf7c0e3abef tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad166de2fea5478da2666ade77017cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6584985c15cf4f69b1ece814924ddc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:29.080334 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-feb29ca1-70b8-4469-a95f-caf7c0e3abef tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853" status: 200 len: 1504 microversion: 2.1 time: 0.393517 Apr 15 19:53:29.084128 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 113/234] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:28 2021] GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853 => generated 1504 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:29.093194 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-3314d2f7-cd94-4674-8ab4-4f7c43c6a72b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:29.097951 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-3314d2f7-cd94-4674-8ab4-4f7c43c6a72b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:29.119539 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3314d2f7-cd94-4674-8ab4-4f7c43c6a72b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:29.120446 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3314d2f7-cd94-4674-8ab4-4f7c43c6a72b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:29.124023 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3314d2f7-cd94-4674-8ab4-4f7c43c6a72b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:29.124943 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3314d2f7-cd94-4674-8ab4-4f7c43c6a72b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:29.307765 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-325be16f-8cb3-4508-b9bc-25c5baa6ae8f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:29.313826 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-3314d2f7-cd94-4674-8ab4-4f7c43c6a72b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 24540 microversion: 2.20 time: 0.226889 Apr 15 19:53:29.315497 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 114/235] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:53:29 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 24540 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:53:29.328167 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-325be16f-8cb3-4508-b9bc-25c5baa6ae8f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1521 microversion: 2.1 time: 0.397156 Apr 15 19:53:29.338585 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 122/236] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:28 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1521 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:30.105580 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-fcc843cd-6a0c-40f8-bce2-7f9cedf5e388 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:30.106622 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-fcc843cd-6a0c-40f8-bce2-7f9cedf5e388 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 574ff274-8b99-4baa-b424-16554e441853] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:30.120571 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fcc843cd-6a0c-40f8-bce2-7f9cedf5e388 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:30.121325 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fcc843cd-6a0c-40f8-bce2-7f9cedf5e388 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:30.122392 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fcc843cd-6a0c-40f8-bce2-7f9cedf5e388 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:30.123077 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fcc843cd-6a0c-40f8-bce2-7f9cedf5e388 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:30.332971 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d0fcbc83-909d-4bcd-9d32-350f977ffa93 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:30.332971 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d0fcbc83-909d-4bcd-9d32-350f977ffa93 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:30.342262 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d0fcbc83-909d-4bcd-9d32-350f977ffa93 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:30.346894 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d0fcbc83-909d-4bcd-9d32-350f977ffa93 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:30.348164 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d0fcbc83-909d-4bcd-9d32-350f977ffa93 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:30.348777 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d0fcbc83-909d-4bcd-9d32-350f977ffa93 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:30.408870 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-fcc843cd-6a0c-40f8-bce2-7f9cedf5e388 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad166de2fea5478da2666ade77017cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6584985c15cf4f69b1ece814924ddc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:30.421831 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-fcc843cd-6a0c-40f8-bce2-7f9cedf5e388 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853" status: 200 len: 1504 microversion: 2.1 time: 0.320825 Apr 15 19:53:30.422712 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 115/237] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:30 2021] GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853 => generated 1504 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:30.441852 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-5a677cb1-4896-40f7-b4ce-82310814d42a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:30.442513 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-5a677cb1-4896-40f7-b4ce-82310814d42a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:30.454874 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5a677cb1-4896-40f7-b4ce-82310814d42a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:30.455434 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5a677cb1-4896-40f7-b4ce-82310814d42a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:30.456410 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5a677cb1-4896-40f7-b4ce-82310814d42a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:30.456906 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5a677cb1-4896-40f7-b4ce-82310814d42a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:30.521632 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d0fcbc83-909d-4bcd-9d32-350f977ffa93 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 25715 microversion: 2.20 time: 0.199008 Apr 15 19:53:30.523169 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 123/238] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:53:30 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 25715 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 15 19:53:30.888207 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-5a677cb1-4896-40f7-b4ce-82310814d42a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:30.899794 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-5a677cb1-4896-40f7-b4ce-82310814d42a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1521 microversion: 2.1 time: 0.475557 Apr 15 19:53:30.900441 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 116/239] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:30 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1521 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:31.441554 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9e05880a-061c-4779-a623-109244821bb9 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:31.443004 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9e05880a-061c-4779-a623-109244821bb9 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 574ff274-8b99-4baa-b424-16554e441853] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:31.459681 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9e05880a-061c-4779-a623-109244821bb9 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:31.460681 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9e05880a-061c-4779-a623-109244821bb9 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:31.463545 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9e05880a-061c-4779-a623-109244821bb9 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:31.464278 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9e05880a-061c-4779-a623-109244821bb9 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:31.536911 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-557e530a-6e5d-484c-9777-6de07e4dfcb8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:31.539151 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-557e530a-6e5d-484c-9777-6de07e4dfcb8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:31.567361 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-557e530a-6e5d-484c-9777-6de07e4dfcb8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:31.569866 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-557e530a-6e5d-484c-9777-6de07e4dfcb8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:31.572232 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-557e530a-6e5d-484c-9777-6de07e4dfcb8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:31.573356 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-557e530a-6e5d-484c-9777-6de07e4dfcb8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:31.826133 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-557e530a-6e5d-484c-9777-6de07e4dfcb8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 27198 microversion: 2.20 time: 0.295629 Apr 15 19:53:31.827506 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 117/240] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:53:31 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 27198 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:53:31.920128 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-471fbc97-bcac-4d6d-97ed-be6f6edef5ac tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:31.921115 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-471fbc97-bcac-4d6d-97ed-be6f6edef5ac tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:31.940551 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-471fbc97-bcac-4d6d-97ed-be6f6edef5ac tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:31.946268 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-471fbc97-bcac-4d6d-97ed-be6f6edef5ac tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:31.947568 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-471fbc97-bcac-4d6d-97ed-be6f6edef5ac tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:31.948395 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-471fbc97-bcac-4d6d-97ed-be6f6edef5ac tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:31.973677 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9e05880a-061c-4779-a623-109244821bb9 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad166de2fea5478da2666ade77017cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6584985c15cf4f69b1ece814924ddc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:31.992163 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9e05880a-061c-4779-a623-109244821bb9 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853" status: 200 len: 1504 microversion: 2.1 time: 0.549571 Apr 15 19:53:31.992859 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 124/241] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:31 2021] GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853 => generated 1504 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:32.838346 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-27df4529-1fc8-41b5-82cf-30001635bf9f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:32.839461 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-27df4529-1fc8-41b5-82cf-30001635bf9f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:32.853437 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-27df4529-1fc8-41b5-82cf-30001635bf9f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:32.854750 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-27df4529-1fc8-41b5-82cf-30001635bf9f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:32.856022 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-27df4529-1fc8-41b5-82cf-30001635bf9f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:32.856717 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-27df4529-1fc8-41b5-82cf-30001635bf9f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:32.857888 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-471fbc97-bcac-4d6d-97ed-be6f6edef5ac tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:32.871934 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-471fbc97-bcac-4d6d-97ed-be6f6edef5ac tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1521 microversion: 2.1 time: 0.957388 Apr 15 19:53:32.872554 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 118/242] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:31 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1521 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:32.991510 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-27df4529-1fc8-41b5-82cf-30001635bf9f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 27668 microversion: 2.20 time: 0.156924 Apr 15 19:53:32.992201 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 125/243] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:53:32 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 27668 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:53:33.013501 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-5b26c951-3f18-40c8-9c7c-ff125fef3042 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:33.014282 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-5b26c951-3f18-40c8-9c7c-ff125fef3042 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 574ff274-8b99-4baa-b424-16554e441853] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:33.030012 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5b26c951-3f18-40c8-9c7c-ff125fef3042 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:33.031630 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5b26c951-3f18-40c8-9c7c-ff125fef3042 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:33.036151 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5b26c951-3f18-40c8-9c7c-ff125fef3042 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:33.036759 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5b26c951-3f18-40c8-9c7c-ff125fef3042 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:33.114766 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-6ae71c95-1daa-464a-9b11-53e124c460f9 req-bee5b424-6dba-4fad-9f88-4786411338d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "574ff274-8b99-4baa-b424-16554e441853", "name": "network-vif-deleted", "tag": "a74c0278-5340-462f-a994-ad5e3c6fc1d8"}]} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:33.116575 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:53:33.116575 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:53:33.148252 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-6ae71c95-1daa-464a-9b11-53e124c460f9 req-bee5b424-6dba-4fad-9f88-4786411338d3 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:33.148750 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-6ae71c95-1daa-464a-9b11-53e124c460f9 req-bee5b424-6dba-4fad-9f88-4786411338d3 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:33.189905 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-6ae71c95-1daa-464a-9b11-53e124c460f9 req-bee5b424-6dba-4fad-9f88-4786411338d3 service nova] Creating event network-vif-deleted:a74c0278-5340-462f-a994-ad5e3c6fc1d8 for instance 574ff274-8b99-4baa-b424-16554e441853 on hv-cinder-78638 Apr 15 19:53:33.199923 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-6ae71c95-1daa-464a-9b11-53e124c460f9 req-bee5b424-6dba-4fad-9f88-4786411338d3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096119 Apr 15 19:53:33.200499 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 126/244] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:53:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 15 19:53:33.371332 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-5b26c951-3f18-40c8-9c7c-ff125fef3042 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad166de2fea5478da2666ade77017cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6584985c15cf4f69b1ece814924ddc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:33.381456 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-5b26c951-3f18-40c8-9c7c-ff125fef3042 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853" status: 200 len: 1462 microversion: 2.1 time: 0.372159 Apr 15 19:53:33.382574 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 119/245] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:33 2021] GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853 => generated 1462 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:33.891512 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-51c1bd8c-d641-4e31-8c49-88f148470c9a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:33.892791 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-51c1bd8c-d641-4e31-8c49-88f148470c9a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:33.903073 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-51c1bd8c-d641-4e31-8c49-88f148470c9a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:33.904163 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-51c1bd8c-d641-4e31-8c49-88f148470c9a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:33.905392 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-51c1bd8c-d641-4e31-8c49-88f148470c9a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:33.906082 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-51c1bd8c-d641-4e31-8c49-88f148470c9a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:34.003550 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ffcc6aff-7782-49f1-8ecf-0960913dd50c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:34.005065 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ffcc6aff-7782-49f1-8ecf-0960913dd50c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:34.028948 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ffcc6aff-7782-49f1-8ecf-0960913dd50c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:34.029464 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ffcc6aff-7782-49f1-8ecf-0960913dd50c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:34.030329 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ffcc6aff-7782-49f1-8ecf-0960913dd50c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:34.039019 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ffcc6aff-7782-49f1-8ecf-0960913dd50c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:34.210185 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ffcc6aff-7782-49f1-8ecf-0960913dd50c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28097 microversion: 2.20 time: 0.209986 Apr 15 19:53:34.211673 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 120/246] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:53:33 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28097 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:53:34.385469 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-51c1bd8c-d641-4e31-8c49-88f148470c9a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:34.398801 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-51c1bd8c-d641-4e31-8c49-88f148470c9a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1521 microversion: 2.1 time: 0.512058 Apr 15 19:53:34.400361 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 127/247] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:33 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1521 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:34.400803 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-63e7acc2-194a-4b2f-bb5c-15944ce14221 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:34.401645 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-63e7acc2-194a-4b2f-bb5c-15944ce14221 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 574ff274-8b99-4baa-b424-16554e441853] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:34.410973 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-63e7acc2-194a-4b2f-bb5c-15944ce14221 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:34.411734 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-63e7acc2-194a-4b2f-bb5c-15944ce14221 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:34.412732 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-63e7acc2-194a-4b2f-bb5c-15944ce14221 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:34.413359 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-63e7acc2-194a-4b2f-bb5c-15944ce14221 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:34.474258 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-63e7acc2-194a-4b2f-bb5c-15944ce14221 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] HTTP exception thrown: Instance 574ff274-8b99-4baa-b424-16554e441853 could not be found. Apr 15 19:53:34.477886 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-63e7acc2-194a-4b2f-bb5c-15944ce14221 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Returning 404 to user: Instance 574ff274-8b99-4baa-b424-16554e441853 could not be found. {{(pid=99512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 19:53:34.479042 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-63e7acc2-194a-4b2f-bb5c-15944ce14221 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853" status: 404 len: 111 microversion: 2.1 time: 0.082577 Apr 15 19:53:34.479687 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 121/248] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:34 2021] GET /compute/v2.1/servers/574ff274-8b99-4baa-b424-16554e441853 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 15 19:53:34.666382 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e5fe244d-22fc-40c4-91b9-03797752750f tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-988596810", "imageRef": "10d66d6e-f687-4228-93d1-67502c9b42e2", "flavorRef": "452", "networks": [{"uuid": "3c5af1e6-577a-4a61-8cee-f71c73717efa"}]}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:34.746011 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.network.neutron [None req-e5fe244d-22fc-40c4-91b9-03797752750f tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] validate_networks() for [('3c5af1e6-577a-4a61-8cee-f71c73717efa', None, None, None)] {{(pid=99511) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 15 19:53:35.222798 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-176f3aa3-a808-4b1e-9898-eac2929c1662 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:35.224787 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-176f3aa3-a808-4b1e-9898-eac2929c1662 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:35.233420 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-176f3aa3-a808-4b1e-9898-eac2929c1662 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:35.234353 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-176f3aa3-a808-4b1e-9898-eac2929c1662 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:35.236095 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-176f3aa3-a808-4b1e-9898-eac2929c1662 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:35.236744 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-176f3aa3-a808-4b1e-9898-eac2929c1662 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:35.396885 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-176f3aa3-a808-4b1e-9898-eac2929c1662 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28214 microversion: 2.20 time: 0.178368 Apr 15 19:53:35.402451 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 122/249] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:53:35 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28214 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:53:35.421341 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-0feff29c-7a54-41aa-989a-000bb2eb5cf8 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:35.422532 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-0feff29c-7a54-41aa-989a-000bb2eb5cf8 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:35.452909 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0feff29c-7a54-41aa-989a-000bb2eb5cf8 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:35.453468 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0feff29c-7a54-41aa-989a-000bb2eb5cf8 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:35.454801 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0feff29c-7a54-41aa-989a-000bb2eb5cf8 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:35.455263 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0feff29c-7a54-41aa-989a-000bb2eb5cf8 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:35.558647 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-e5fe244d-22fc-40c4-91b9-03797752750f tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Flavor limits 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 15 19:53:35.559327 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-e5fe244d-22fc-40c4-91b9-03797752750f tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Image limits 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 15 19:53:35.560018 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-e5fe244d-22fc-40c4-91b9-03797752750f tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Flavor pref 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 15 19:53:35.560855 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-e5fe244d-22fc-40c4-91b9-03797752750f tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Image pref 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 15 19:53:35.561499 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-e5fe244d-22fc-40c4-91b9-03797752750f tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 15 19:53:35.579567 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e5fe244d-22fc-40c4-91b9-03797752750f tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:35.581919 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e5fe244d-22fc-40c4-91b9-03797752750f tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:35.586715 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e5fe244d-22fc-40c4-91b9-03797752750f tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:35.586715 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e5fe244d-22fc-40c4-91b9-03797752750f tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:35.607481 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-e5fe244d-22fc-40c4-91b9-03797752750f tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Getting quotas for project 6584985c15cf4f69b1ece814924ddc62. Resources: {'cores', 'instances', 'ram'} {{(pid=99511) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 15 19:53:35.613211 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-e5fe244d-22fc-40c4-91b9-03797752750f tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Getting quotas for user ad166de2fea5478da2666ade77017cbf and project 6584985c15cf4f69b1ece814924ddc62. Resources: {'cores', 'instances', 'ram'} {{(pid=99511) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 15 19:53:35.629133 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e5fe244d-22fc-40c4-91b9-03797752750f tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Going to run 1 instances... {{(pid=99511) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 15 19:53:35.634512 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e5fe244d-22fc-40c4-91b9-03797752750f tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 2ac93376-e982-4a6d-9b4a-f647bc2169ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='10d66d6e-f687-4228-93d1-67502c9b42e2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 15 19:53:35.714947 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e5fe244d-22fc-40c4-91b9-03797752750f tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.053245 Apr 15 19:53:35.722817 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 128/250] 10.222.0.58 () {60 vars in 1137 bytes} [Thu Apr 15 19:53:34 2021] POST /compute/v2.1/servers => generated 380 bytes in 1062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 15 19:53:35.728226 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9cdf7b91-2ba5-4b6b-8d34-acaccbf30ebb tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:35.729166 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9cdf7b91-2ba5-4b6b-8d34-acaccbf30ebb tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 2ac93376-e982-4a6d-9b4a-f647bc2169ea] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:35.829114 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9cdf7b91-2ba5-4b6b-8d34-acaccbf30ebb tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad166de2fea5478da2666ade77017cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6584985c15cf4f69b1ece814924ddc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:35.846590 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9cdf7b91-2ba5-4b6b-8d34-acaccbf30ebb tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/2ac93376-e982-4a6d-9b4a-f647bc2169ea" status: 200 len: 1213 microversion: 2.1 time: 0.122266 Apr 15 19:53:35.847983 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 129/251] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:35 2021] GET /compute/v2.1/servers/2ac93376-e982-4a6d-9b4a-f647bc2169ea => generated 1213 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:36.007023 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-0feff29c-7a54-41aa-989a-000bb2eb5cf8 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:36.017586 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-0feff29c-7a54-41aa-989a-000bb2eb5cf8 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1521 microversion: 2.1 time: 0.602433 Apr 15 19:53:36.023708 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 123/252] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:35 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1521 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:53:36.411610 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-84f37f7a-1aab-44e5-b412-ea32cc20d0dc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:36.413512 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-84f37f7a-1aab-44e5-b412-ea32cc20d0dc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:36.425811 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-84f37f7a-1aab-44e5-b412-ea32cc20d0dc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:36.426817 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-84f37f7a-1aab-44e5-b412-ea32cc20d0dc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:36.428157 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-84f37f7a-1aab-44e5-b412-ea32cc20d0dc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:36.429142 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-84f37f7a-1aab-44e5-b412-ea32cc20d0dc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:36.557815 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-84f37f7a-1aab-44e5-b412-ea32cc20d0dc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28214 microversion: 2.20 time: 0.151494 Apr 15 19:53:36.563394 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 130/253] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:53:36 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28214 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:53:36.866150 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-1db01cc9-ab74-46b5-a23d-eecaaa580b92 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:36.866816 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-1db01cc9-ab74-46b5-a23d-eecaaa580b92 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 2ac93376-e982-4a6d-9b4a-f647bc2169ea] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:36.914127 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1db01cc9-ab74-46b5-a23d-eecaaa580b92 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:36.914711 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1db01cc9-ab74-46b5-a23d-eecaaa580b92 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:36.915684 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1db01cc9-ab74-46b5-a23d-eecaaa580b92 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:36.916231 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1db01cc9-ab74-46b5-a23d-eecaaa580b92 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:37.036937 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-fc3e5989-2c61-436e-bce8-ad133413c696 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:37.037718 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-fc3e5989-2c61-436e-bce8-ad133413c696 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:37.052991 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fc3e5989-2c61-436e-bce8-ad133413c696 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:37.053435 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fc3e5989-2c61-436e-bce8-ad133413c696 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:37.054332 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fc3e5989-2c61-436e-bce8-ad133413c696 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:37.054837 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fc3e5989-2c61-436e-bce8-ad133413c696 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:37.250017 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-1db01cc9-ab74-46b5-a23d-eecaaa580b92 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad166de2fea5478da2666ade77017cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6584985c15cf4f69b1ece814924ddc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:37.259470 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-1db01cc9-ab74-46b5-a23d-eecaaa580b92 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/2ac93376-e982-4a6d-9b4a-f647bc2169ea" status: 200 len: 1265 microversion: 2.1 time: 0.397319 Apr 15 19:53:37.270544 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 124/254] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:36 2021] GET /compute/v2.1/servers/2ac93376-e982-4a6d-9b4a-f647bc2169ea => generated 1265 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:37.551654 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-fc3e5989-2c61-436e-bce8-ad133413c696 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:37.564436 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-fc3e5989-2c61-436e-bce8-ad133413c696 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1521 microversion: 2.1 time: 0.532204 Apr 15 19:53:37.565936 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 131/255] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:37 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1521 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:37.570526 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-8bdc2ce4-8958-456f-967d-8763e51bb5fb tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:37.571788 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-8bdc2ce4-8958-456f-967d-8763e51bb5fb tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:37.579606 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8bdc2ce4-8958-456f-967d-8763e51bb5fb tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:37.580198 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8bdc2ce4-8958-456f-967d-8763e51bb5fb tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:37.581267 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8bdc2ce4-8958-456f-967d-8763e51bb5fb tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:37.581825 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8bdc2ce4-8958-456f-967d-8763e51bb5fb tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:37.687756 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-8bdc2ce4-8958-456f-967d-8763e51bb5fb tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28214 microversion: 2.20 time: 0.120608 Apr 15 19:53:37.694403 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 125/256] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:53:37 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28214 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:53:38.279425 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-4764c671-2cd8-40ef-9f88-ee06a20075d1 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:38.280107 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-4764c671-2cd8-40ef-9f88-ee06a20075d1 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 2ac93376-e982-4a6d-9b4a-f647bc2169ea] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:38.294077 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4764c671-2cd8-40ef-9f88-ee06a20075d1 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:38.294591 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4764c671-2cd8-40ef-9f88-ee06a20075d1 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:38.295477 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4764c671-2cd8-40ef-9f88-ee06a20075d1 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:38.304162 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4764c671-2cd8-40ef-9f88-ee06a20075d1 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:38.587724 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-fae92bad-f473-4a90-a181-72828510cfec tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:38.588722 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-fae92bad-f473-4a90-a181-72828510cfec tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:38.618822 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fae92bad-f473-4a90-a181-72828510cfec tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:38.621147 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fae92bad-f473-4a90-a181-72828510cfec tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:38.622991 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fae92bad-f473-4a90-a181-72828510cfec tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:38.624459 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fae92bad-f473-4a90-a181-72828510cfec tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:39.785759 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-fae92bad-f473-4a90-a181-72828510cfec tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:39.802670 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-fae92bad-f473-4a90-a181-72828510cfec tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1521 microversion: 2.1 time: 1.223564 Apr 15 19:53:39.803826 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 126/257] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:38 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1521 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:39.817470 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-1a123ad6-f677-4e46-87ed-562fae096ade tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:39.818546 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-1a123ad6-f677-4e46-87ed-562fae096ade tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:39.834809 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1a123ad6-f677-4e46-87ed-562fae096ade tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:39.836525 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1a123ad6-f677-4e46-87ed-562fae096ade tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:39.837394 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1a123ad6-f677-4e46-87ed-562fae096ade tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:39.837891 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1a123ad6-f677-4e46-87ed-562fae096ade tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:39.970912 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-4764c671-2cd8-40ef-9f88-ee06a20075d1 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad166de2fea5478da2666ade77017cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6584985c15cf4f69b1ece814924ddc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:39.992470 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-4764c671-2cd8-40ef-9f88-ee06a20075d1 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/2ac93376-e982-4a6d-9b4a-f647bc2169ea" status: 200 len: 1313 microversion: 2.1 time: 1.716430 Apr 15 19:53:39.993184 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 132/258] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:38 2021] GET /compute/v2.1/servers/2ac93376-e982-4a6d-9b4a-f647bc2169ea => generated 1313 bytes in 1720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:40.038805 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-1a123ad6-f677-4e46-87ed-562fae096ade tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28214 microversion: 2.20 time: 0.233206 Apr 15 19:53:40.039926 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 127/259] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:53:39 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28214 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:53:40.821932 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c160c6ba-a7cd-4d69-8ff6-7355b0af90bd tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:40.822585 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c160c6ba-a7cd-4d69-8ff6-7355b0af90bd tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:40.841628 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c160c6ba-a7cd-4d69-8ff6-7355b0af90bd tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:40.849174 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c160c6ba-a7cd-4d69-8ff6-7355b0af90bd tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:40.850502 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c160c6ba-a7cd-4d69-8ff6-7355b0af90bd tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:40.851190 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c160c6ba-a7cd-4d69-8ff6-7355b0af90bd tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:41.013379 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-88ed0104-b3e6-4025-8855-4a881afe1f4b tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:41.014204 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-88ed0104-b3e6-4025-8855-4a881afe1f4b tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 2ac93376-e982-4a6d-9b4a-f647bc2169ea] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:41.046322 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-88ed0104-b3e6-4025-8855-4a881afe1f4b tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:41.046506 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-88ed0104-b3e6-4025-8855-4a881afe1f4b tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:41.059491 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-88ed0104-b3e6-4025-8855-4a881afe1f4b tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:41.060903 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-88ed0104-b3e6-4025-8855-4a881afe1f4b tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:42.335096 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c160c6ba-a7cd-4d69-8ff6-7355b0af90bd tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:42.348427 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c160c6ba-a7cd-4d69-8ff6-7355b0af90bd tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1521 microversion: 2.1 time: 1.530389 Apr 15 19:53:42.349539 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 133/260] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:40 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1521 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:42.355991 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ce6bdc33-f2ca-4cbb-8815-b9d60e51fee3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:42.357385 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ce6bdc33-f2ca-4cbb-8815-b9d60e51fee3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:42.365054 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-88ed0104-b3e6-4025-8855-4a881afe1f4b tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad166de2fea5478da2666ade77017cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6584985c15cf4f69b1ece814924ddc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:42.376706 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ce6bdc33-f2ca-4cbb-8815-b9d60e51fee3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:42.377730 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ce6bdc33-f2ca-4cbb-8815-b9d60e51fee3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:42.378857 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ce6bdc33-f2ca-4cbb-8815-b9d60e51fee3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:42.379761 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ce6bdc33-f2ca-4cbb-8815-b9d60e51fee3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:42.381690 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-88ed0104-b3e6-4025-8855-4a881afe1f4b tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/2ac93376-e982-4a6d-9b4a-f647bc2169ea" status: 200 len: 1313 microversion: 2.1 time: 1.367715 Apr 15 19:53:42.395482 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 128/261] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:41 2021] GET /compute/v2.1/servers/2ac93376-e982-4a6d-9b4a-f647bc2169ea => generated 1313 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:42.404259 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-4d2f337d-042c-46c0-b16c-646f433e9be9 req-7104aa49-d559-4224-b2f2-14be7243a9ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ac93376-e982-4a6d-9b4a-f647bc2169ea", "tag": "9de8e0f3-45b4-4d41-bae6-d5eaaae4abc0"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:42.404595 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:53:42.404595 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:53:42.425824 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-4d2f337d-042c-46c0-b16c-646f433e9be9 req-7104aa49-d559-4224-b2f2-14be7243a9ff service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:42.426328 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-4d2f337d-042c-46c0-b16c-646f433e9be9 req-7104aa49-d559-4224-b2f2-14be7243a9ff service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:42.444259 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-4d2f337d-042c-46c0-b16c-646f433e9be9 req-7104aa49-d559-4224-b2f2-14be7243a9ff service nova] Creating event network-changed:9de8e0f3-45b4-4d41-bae6-d5eaaae4abc0 for instance 2ac93376-e982-4a6d-9b4a-f647bc2169ea on hv-cinder-78638 Apr 15 19:53:42.449895 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-4d2f337d-042c-46c0-b16c-646f433e9be9 req-7104aa49-d559-4224-b2f2-14be7243a9ff service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060681 Apr 15 19:53:42.451030 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 129/262] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:53:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:53:42.534760 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ce6bdc33-f2ca-4cbb-8815-b9d60e51fee3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28214 microversion: 2.20 time: 0.183192 Apr 15 19:53:42.535587 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 134/263] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:53:42 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28214 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:53:43.367324 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9c2a3381-e177-4de7-a30c-013f95b33b7f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:43.368174 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9c2a3381-e177-4de7-a30c-013f95b33b7f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:43.384295 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9c2a3381-e177-4de7-a30c-013f95b33b7f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:43.389148 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9c2a3381-e177-4de7-a30c-013f95b33b7f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:43.390478 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9c2a3381-e177-4de7-a30c-013f95b33b7f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:43.394845 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9c2a3381-e177-4de7-a30c-013f95b33b7f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:43.404922 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7e181bbc-8d91-4d57-b0dc-047ab666c31f tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:43.405707 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7e181bbc-8d91-4d57-b0dc-047ab666c31f tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 2ac93376-e982-4a6d-9b4a-f647bc2169ea] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:43.426787 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7e181bbc-8d91-4d57-b0dc-047ab666c31f tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:43.427312 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7e181bbc-8d91-4d57-b0dc-047ab666c31f tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:43.428274 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7e181bbc-8d91-4d57-b0dc-047ab666c31f tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:43.433730 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7e181bbc-8d91-4d57-b0dc-047ab666c31f tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:44.287848 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-7e181bbc-8d91-4d57-b0dc-047ab666c31f tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad166de2fea5478da2666ade77017cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6584985c15cf4f69b1ece814924ddc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:44.302795 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9c2a3381-e177-4de7-a30c-013f95b33b7f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:44.315597 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7e181bbc-8d91-4d57-b0dc-047ab666c31f tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/2ac93376-e982-4a6d-9b4a-f647bc2169ea" status: 200 len: 1313 microversion: 2.1 time: 0.914652 Apr 15 19:53:44.320364 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9c2a3381-e177-4de7-a30c-013f95b33b7f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1521 microversion: 2.1 time: 0.955264 Apr 15 19:53:44.321000 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 130/264] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:43 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1521 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:44.326831 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 135/265] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:43 2021] GET /compute/v2.1/servers/2ac93376-e982-4a6d-9b4a-f647bc2169ea => generated 1313 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:44.337385 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-dcde7e44-680b-43a2-9455-173efa54ca55 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:44.338649 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-dcde7e44-680b-43a2-9455-173efa54ca55 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:44.348082 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dcde7e44-680b-43a2-9455-173efa54ca55 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:44.348830 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dcde7e44-680b-43a2-9455-173efa54ca55 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:44.349825 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dcde7e44-680b-43a2-9455-173efa54ca55 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:44.350619 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dcde7e44-680b-43a2-9455-173efa54ca55 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:44.548060 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-dcde7e44-680b-43a2-9455-173efa54ca55 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28214 microversion: 2.20 time: 0.223609 Apr 15 19:53:44.548788 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 131/266] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:53:44 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28214 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:53:45.333891 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-640a6b6e-4172-478d-9826-813540c10b26 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:45.335709 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-640a6b6e-4172-478d-9826-813540c10b26 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 2ac93376-e982-4a6d-9b4a-f647bc2169ea] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:45.338950 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-dabb40ec-463c-4d48-a9e3-b0b167898f3f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:45.340157 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-dabb40ec-463c-4d48-a9e3-b0b167898f3f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:45.346270 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-640a6b6e-4172-478d-9826-813540c10b26 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:45.346975 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-640a6b6e-4172-478d-9826-813540c10b26 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:45.348129 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-640a6b6e-4172-478d-9826-813540c10b26 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:45.348899 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-640a6b6e-4172-478d-9826-813540c10b26 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:45.350506 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dabb40ec-463c-4d48-a9e3-b0b167898f3f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:45.351221 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dabb40ec-463c-4d48-a9e3-b0b167898f3f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:45.352460 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dabb40ec-463c-4d48-a9e3-b0b167898f3f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:45.353166 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dabb40ec-463c-4d48-a9e3-b0b167898f3f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:45.670839 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-640a6b6e-4172-478d-9826-813540c10b26 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad166de2fea5478da2666ade77017cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6584985c15cf4f69b1ece814924ddc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:45.685904 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-640a6b6e-4172-478d-9826-813540c10b26 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/2ac93376-e982-4a6d-9b4a-f647bc2169ea" status: 200 len: 1313 microversion: 2.1 time: 0.356485 Apr 15 19:53:45.699481 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 136/267] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:45 2021] GET /compute/v2.1/servers/2ac93376-e982-4a6d-9b4a-f647bc2169ea => generated 1313 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:45.706247 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-90c0d624-84d4-4bf5-8d3e-c4aacc613e74 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:45.708105 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-90c0d624-84d4-4bf5-8d3e-c4aacc613e74 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:45.716828 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-90c0d624-84d4-4bf5-8d3e-c4aacc613e74 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:45.717550 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-90c0d624-84d4-4bf5-8d3e-c4aacc613e74 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:45.718549 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-90c0d624-84d4-4bf5-8d3e-c4aacc613e74 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:45.719927 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-90c0d624-84d4-4bf5-8d3e-c4aacc613e74 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:45.825810 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-dabb40ec-463c-4d48-a9e3-b0b167898f3f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:45.835325 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-dabb40ec-463c-4d48-a9e3-b0b167898f3f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1501 microversion: 2.1 time: 0.500784 Apr 15 19:53:45.836204 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 132/268] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:45 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1501 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:53:45.853504 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-30a75bc2-6c26-4312-a242-be3ce1d51a67 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:45.853727 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-30a75bc2-6c26-4312-a242-be3ce1d51a67 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:45.862626 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-30a75bc2-6c26-4312-a242-be3ce1d51a67 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:45.863482 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-30a75bc2-6c26-4312-a242-be3ce1d51a67 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:45.866346 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-30a75bc2-6c26-4312-a242-be3ce1d51a67 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:45.867086 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-30a75bc2-6c26-4312-a242-be3ce1d51a67 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:46.098696 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-30a75bc2-6c26-4312-a242-be3ce1d51a67 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:46.110623 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-30a75bc2-6c26-4312-a242-be3ce1d51a67 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1516 microversion: 2.1 time: 0.261459 Apr 15 19:53:46.116796 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 133/269] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:45 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1516 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:46.709599 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-831e3de3-04c6-4287-afbb-00e8be17c19e tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:46.710267 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-831e3de3-04c6-4287-afbb-00e8be17c19e tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 2ac93376-e982-4a6d-9b4a-f647bc2169ea] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:46.740547 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-831e3de3-04c6-4287-afbb-00e8be17c19e tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:46.741344 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-831e3de3-04c6-4287-afbb-00e8be17c19e tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:46.742529 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-831e3de3-04c6-4287-afbb-00e8be17c19e tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:46.744452 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-831e3de3-04c6-4287-afbb-00e8be17c19e tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:47.138108 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-831e3de3-04c6-4287-afbb-00e8be17c19e tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad166de2fea5478da2666ade77017cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6584985c15cf4f69b1ece814924ddc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:47.146953 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-831e3de3-04c6-4287-afbb-00e8be17c19e tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/2ac93376-e982-4a6d-9b4a-f647bc2169ea" status: 200 len: 1313 microversion: 2.1 time: 0.444231 Apr 15 19:53:47.147777 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 134/270] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:46 2021] GET /compute/v2.1/servers/2ac93376-e982-4a6d-9b4a-f647bc2169ea => generated 1313 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:48.158543 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-80d09253-4a2e-4d4d-9a1a-d23a880cdfc7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'create', calling method: .version_select at 0x7f18d8c399d8>, body: {"keypair": {"name": "tempest-keypair-1011932143"}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:48.183780 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-80d09253-4a2e-4d4d-9a1a-d23a880cdfc7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Getting quotas for project fba23e5df9154ee5b97b92e3f9090983. Resources: {'key_pairs'} {{(pid=99512) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 15 19:53:48.188325 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-80d09253-4a2e-4d4d-9a1a-d23a880cdfc7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Getting quotas for user c94a8e6666654a7f969179a50453efac and project fba23e5df9154ee5b97b92e3f9090983. Resources: {'key_pairs'} {{(pid=99512) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 15 19:53:48.312483 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-80d09253-4a2e-4d4d-9a1a-d23a880cdfc7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Getting quotas for project fba23e5df9154ee5b97b92e3f9090983. Resources: {'key_pairs'} {{(pid=99512) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 15 19:53:48.316700 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-80d09253-4a2e-4d4d-9a1a-d23a880cdfc7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Getting quotas for user c94a8e6666654a7f969179a50453efac and project fba23e5df9154ee5b97b92e3f9090983. Resources: {'key_pairs'} {{(pid=99512) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 15 19:53:48.330850 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-80d09253-4a2e-4d4d-9a1a-d23a880cdfc7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.369707 Apr 15 19:53:48.331540 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 135/271] 10.222.0.58 () {60 vars in 1148 bytes} [Thu Apr 15 19:53:47 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:53:48.338100 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-303b5a5f-8afa-4e31-ab3a-f1fa030290e7 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:48.338873 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-303b5a5f-8afa-4e31-ab3a-f1fa030290e7 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 2ac93376-e982-4a6d-9b4a-f647bc2169ea] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:48.348886 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-303b5a5f-8afa-4e31-ab3a-f1fa030290e7 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:48.349488 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-303b5a5f-8afa-4e31-ab3a-f1fa030290e7 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:48.350419 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-303b5a5f-8afa-4e31-ab3a-f1fa030290e7 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:48.350995 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-303b5a5f-8afa-4e31-ab3a-f1fa030290e7 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:48.596059 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-303b5a5f-8afa-4e31-ab3a-f1fa030290e7 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad166de2fea5478da2666ade77017cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6584985c15cf4f69b1ece814924ddc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:48.604842 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-303b5a5f-8afa-4e31-ab3a-f1fa030290e7 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/2ac93376-e982-4a6d-9b4a-f647bc2169ea" status: 200 len: 1313 microversion: 2.1 time: 0.271125 Apr 15 19:53:48.605475 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 136/272] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:48 2021] GET /compute/v2.1/servers/2ac93376-e982-4a6d-9b4a-f647bc2169ea => generated 1313 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:49.348991 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-90c0d624-84d4-4bf5-8d3e-c4aacc613e74 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28214 microversion: 2.20 time: 3.646728 Apr 15 19:53:49.353167 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 137/273] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:53:45 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28214 bytes in 3649 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:53:49.622386 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-379b9958-e540-48c8-9a73-14f897e4d2b4 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:49.623385 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-379b9958-e540-48c8-9a73-14f897e4d2b4 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 2ac93376-e982-4a6d-9b4a-f647bc2169ea] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:49.632804 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-379b9958-e540-48c8-9a73-14f897e4d2b4 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:49.633600 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-379b9958-e540-48c8-9a73-14f897e4d2b4 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:49.634618 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-379b9958-e540-48c8-9a73-14f897e4d2b4 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:49.635110 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-379b9958-e540-48c8-9a73-14f897e4d2b4 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:50.034504 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-379b9958-e540-48c8-9a73-14f897e4d2b4 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad166de2fea5478da2666ade77017cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6584985c15cf4f69b1ece814924ddc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:50.057984 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-379b9958-e540-48c8-9a73-14f897e4d2b4 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/2ac93376-e982-4a6d-9b4a-f647bc2169ea" status: 200 len: 1313 microversion: 2.1 time: 0.439572 Apr 15 19:53:50.058590 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 137/274] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:49 2021] GET /compute/v2.1/servers/2ac93376-e982-4a6d-9b4a-f647bc2169ea => generated 1313 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:50.361949 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-2a72dab7-495f-48a9-8a53-0af131e298dc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:50.363801 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-2a72dab7-495f-48a9-8a53-0af131e298dc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:50.374148 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2a72dab7-495f-48a9-8a53-0af131e298dc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:50.374676 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2a72dab7-495f-48a9-8a53-0af131e298dc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:50.377277 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2a72dab7-495f-48a9-8a53-0af131e298dc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:50.379847 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2a72dab7-495f-48a9-8a53-0af131e298dc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:50.474225 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-593d0c4a-2a13-4937-abe5-d06c71c823f7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-376357112", "imageRef": "10d66d6e-f687-4228-93d1-67502c9b42e2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "841e7241-ffd3-4269-8bb7-4b3adadc6e3d"}], "security_groups": [{"name": "tempest-securitygroup--571857027"}], "key_name": "tempest-keypair-1011932143", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:50.710667 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.network.neutron [None req-593d0c4a-2a13-4937-abe5-d06c71c823f7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] validate_networks() for [('841e7241-ffd3-4269-8bb7-4b3adadc6e3d', None, None, None)] {{(pid=99512) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 15 19:53:50.917544 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-2a72dab7-495f-48a9-8a53-0af131e298dc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28214 microversion: 2.20 time: 0.559834 Apr 15 19:53:50.918652 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 138/275] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:53:50 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28214 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:53:51.082938 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-1c1ac7fc-dcac-4fd2-bd49-fb8a367feb17 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:51.084064 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-1c1ac7fc-dcac-4fd2-bd49-fb8a367feb17 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 2ac93376-e982-4a6d-9b4a-f647bc2169ea] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:51.093633 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1c1ac7fc-dcac-4fd2-bd49-fb8a367feb17 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:51.094781 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1c1ac7fc-dcac-4fd2-bd49-fb8a367feb17 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:51.095910 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1c1ac7fc-dcac-4fd2-bd49-fb8a367feb17 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:51.096589 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1c1ac7fc-dcac-4fd2-bd49-fb8a367feb17 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:51.818769 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-1c1ac7fc-dcac-4fd2-bd49-fb8a367feb17 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad166de2fea5478da2666ade77017cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6584985c15cf4f69b1ece814924ddc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:51.832104 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-1c1ac7fc-dcac-4fd2-bd49-fb8a367feb17 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/2ac93376-e982-4a6d-9b4a-f647bc2169ea" status: 200 len: 1313 microversion: 2.1 time: 0.755122 Apr 15 19:53:51.833122 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 139/276] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:51 2021] GET /compute/v2.1/servers/2ac93376-e982-4a6d-9b4a-f647bc2169ea => generated 1313 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:53:51.887003 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-593d0c4a-2a13-4937-abe5-d06c71c823f7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Flavor limits 0:0:0 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 15 19:53:51.887671 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-593d0c4a-2a13-4937-abe5-d06c71c823f7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Image limits 0:0:0 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 15 19:53:51.888226 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-593d0c4a-2a13-4937-abe5-d06c71c823f7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Flavor pref 0:0:0 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 15 19:53:51.888835 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-593d0c4a-2a13-4937-abe5-d06c71c823f7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Image pref 0:0:0 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 15 19:53:51.889299 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-593d0c4a-2a13-4937-abe5-d06c71c823f7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 15 19:53:51.900025 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-593d0c4a-2a13-4937-abe5-d06c71c823f7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:51.900731 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-593d0c4a-2a13-4937-abe5-d06c71c823f7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:51.901876 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-593d0c4a-2a13-4937-abe5-d06c71c823f7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:51.902664 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-593d0c4a-2a13-4937-abe5-d06c71c823f7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:51.923635 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-593d0c4a-2a13-4937-abe5-d06c71c823f7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Getting quotas for project fba23e5df9154ee5b97b92e3f9090983. Resources: {'cores', 'instances', 'ram'} {{(pid=99512) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 15 19:53:51.928958 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-593d0c4a-2a13-4937-abe5-d06c71c823f7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Getting quotas for user c94a8e6666654a7f969179a50453efac and project fba23e5df9154ee5b97b92e3f9090983. Resources: {'cores', 'instances', 'ram'} {{(pid=99512) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 15 19:53:51.930394 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-55dc2aea-3ff0-49f8-8d99-97e6157bc9d9 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:51.931696 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-55dc2aea-3ff0-49f8-8d99-97e6157bc9d9 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:51.940191 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-55dc2aea-3ff0-49f8-8d99-97e6157bc9d9 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:51.940909 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-55dc2aea-3ff0-49f8-8d99-97e6157bc9d9 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:51.941756 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-55dc2aea-3ff0-49f8-8d99-97e6157bc9d9 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:51.942247 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-55dc2aea-3ff0-49f8-8d99-97e6157bc9d9 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:51.942543 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-593d0c4a-2a13-4937-abe5-d06c71c823f7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Going to run 1 instances... {{(pid=99512) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 15 19:53:51.945674 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-593d0c4a-2a13-4937-abe5-d06c71c823f7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='10d66d6e-f687-4228-93d1-67502c9b42e2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 15 19:53:52.029253 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-593d0c4a-2a13-4937-abe5-d06c71c823f7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.559273 Apr 15 19:53:52.030219 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 138/277] 10.222.0.58 () {60 vars in 1137 bytes} [Thu Apr 15 19:53:50 2021] POST /compute/v2.1/servers => generated 401 bytes in 1561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 15 19:53:52.042259 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-cbddeac6-5036-4443-b6aa-af571f01d3e1 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:52.043197 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-cbddeac6-5036-4443-b6aa-af571f01d3e1 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:52.090515 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-55dc2aea-3ff0-49f8-8d99-97e6157bc9d9 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28214 microversion: 2.20 time: 0.163502 Apr 15 19:53:52.095190 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 140/278] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:53:51 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28214 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 15 19:53:52.137829 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-cbddeac6-5036-4443-b6aa-af571f01d3e1 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:52.147086 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-cbddeac6-5036-4443-b6aa-af571f01d3e1 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1237 microversion: 2.1 time: 0.109622 Apr 15 19:53:52.147760 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 139/279] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:52 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1237 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:52.568090 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e03979d2-5b6e-49a7-8d39-dfe5a39bb713 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:52.569262 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e03979d2-5b6e-49a7-8d39-dfe5a39bb713 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:52.578288 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e03979d2-5b6e-49a7-8d39-dfe5a39bb713 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:52.579077 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e03979d2-5b6e-49a7-8d39-dfe5a39bb713 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:52.580094 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e03979d2-5b6e-49a7-8d39-dfe5a39bb713 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:52.580732 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e03979d2-5b6e-49a7-8d39-dfe5a39bb713 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:52.739526 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.objects.instance [None req-e03979d2-5b6e-49a7-8d39-dfe5a39bb713 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lazy-loading 'flavor' on Instance uuid 4f202f3f-01c9-41c6-842e-ee96f6b40094 {{(pid=99511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 15 19:53:52.850338 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-55737581-7dd6-427c-a5b7-f059a8a014c5 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:52.850987 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-55737581-7dd6-427c-a5b7-f059a8a014c5 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 2ac93376-e982-4a6d-9b4a-f647bc2169ea] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:52.865802 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-55737581-7dd6-427c-a5b7-f059a8a014c5 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:52.877024 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-55737581-7dd6-427c-a5b7-f059a8a014c5 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:52.878323 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-55737581-7dd6-427c-a5b7-f059a8a014c5 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:52.879037 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-55737581-7dd6-427c-a5b7-f059a8a014c5 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:52.987479 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e03979d2-5b6e-49a7-8d39-dfe5a39bb713 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "POST /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094/action" status: 200 len: 32 microversion: 2.1 time: 0.421556 Apr 15 19:53:52.987479 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 141/280] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:53:52 2021] POST /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094/action => generated 32 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 15 19:53:53.004485 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-130c29a6-93d0-4290-80a5-fe783118f817 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:53.005443 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-130c29a6-93d0-4290-80a5-fe783118f817 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:53.014547 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-130c29a6-93d0-4290-80a5-fe783118f817 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:53.015508 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-130c29a6-93d0-4290-80a5-fe783118f817 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:53.016551 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-130c29a6-93d0-4290-80a5-fe783118f817 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:53.017186 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-130c29a6-93d0-4290-80a5-fe783118f817 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:53.337703 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-55737581-7dd6-427c-a5b7-f059a8a014c5 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad166de2fea5478da2666ade77017cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6584985c15cf4f69b1ece814924ddc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:53.358552 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-55737581-7dd6-427c-a5b7-f059a8a014c5 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/2ac93376-e982-4a6d-9b4a-f647bc2169ea" status: 200 len: 1313 microversion: 2.1 time: 0.512251 Apr 15 19:53:53.359955 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 140/281] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:52 2021] GET /compute/v2.1/servers/2ac93376-e982-4a6d-9b4a-f647bc2169ea => generated 1313 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:53.365855 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-2624c850-9ab6-430b-9159-3bd2a2812603 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:53.368657 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-2624c850-9ab6-430b-9159-3bd2a2812603 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:53.381354 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2624c850-9ab6-430b-9159-3bd2a2812603 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:53.382763 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2624c850-9ab6-430b-9159-3bd2a2812603 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:53.384618 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2624c850-9ab6-430b-9159-3bd2a2812603 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:53.385351 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2624c850-9ab6-430b-9159-3bd2a2812603 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:53.403852 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-130c29a6-93d0-4290-80a5-fe783118f817 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:53.414347 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-130c29a6-93d0-4290-80a5-fe783118f817 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1522 microversion: 2.1 time: 0.417372 Apr 15 19:53:53.418044 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 142/282] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:52 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1522 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:53.423325 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a16ae640-7668-49e1-9915-bad07111ad42 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:53.424008 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a16ae640-7668-49e1-9915-bad07111ad42 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:53.432044 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a16ae640-7668-49e1-9915-bad07111ad42 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:53.432555 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a16ae640-7668-49e1-9915-bad07111ad42 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:53.433392 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a16ae640-7668-49e1-9915-bad07111ad42 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:53.433881 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a16ae640-7668-49e1-9915-bad07111ad42 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:53.528973 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-2624c850-9ab6-430b-9159-3bd2a2812603 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28214 microversion: 2.20 time: 0.166996 Apr 15 19:53:53.530028 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 141/283] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:53:53 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28214 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:53:53.741832 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a16ae640-7668-49e1-9915-bad07111ad42 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:53.774908 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a16ae640-7668-49e1-9915-bad07111ad42 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1289 microversion: 2.1 time: 0.355648 Apr 15 19:53:53.775945 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 143/284] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:53 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1289 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:54.378798 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-dba73659-cac8-4941-8507-c8523ddd441f tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:54.381183 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-dba73659-cac8-4941-8507-c8523ddd441f tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 2ac93376-e982-4a6d-9b4a-f647bc2169ea] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:54.398359 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dba73659-cac8-4941-8507-c8523ddd441f tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:54.416795 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dba73659-cac8-4941-8507-c8523ddd441f tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:54.418141 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dba73659-cac8-4941-8507-c8523ddd441f tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:54.419644 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dba73659-cac8-4941-8507-c8523ddd441f tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:54.436725 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-cced95aa-7e54-497e-897f-86c5021e0d6b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:54.437398 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-cced95aa-7e54-497e-897f-86c5021e0d6b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:54.456241 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cced95aa-7e54-497e-897f-86c5021e0d6b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:54.456759 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cced95aa-7e54-497e-897f-86c5021e0d6b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:54.457609 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cced95aa-7e54-497e-897f-86c5021e0d6b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:54.463044 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cced95aa-7e54-497e-897f-86c5021e0d6b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:55.287768 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-dba73659-cac8-4941-8507-c8523ddd441f tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad166de2fea5478da2666ade77017cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6584985c15cf4f69b1ece814924ddc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:55.302601 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-dba73659-cac8-4941-8507-c8523ddd441f tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/2ac93376-e982-4a6d-9b4a-f647bc2169ea" status: 200 len: 1313 microversion: 2.1 time: 0.929367 Apr 15 19:53:55.313975 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 142/285] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:54 2021] GET /compute/v2.1/servers/2ac93376-e982-4a6d-9b4a-f647bc2169ea => generated 1313 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:55.320972 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-3974146d-aa2b-4b7e-acca-5f36cfcc5820 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:55.324229 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-3974146d-aa2b-4b7e-acca-5f36cfcc5820 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:55.344512 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3974146d-aa2b-4b7e-acca-5f36cfcc5820 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:55.347979 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3974146d-aa2b-4b7e-acca-5f36cfcc5820 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:55.349261 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3974146d-aa2b-4b7e-acca-5f36cfcc5820 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:55.351371 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3974146d-aa2b-4b7e-acca-5f36cfcc5820 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:55.376934 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-cced95aa-7e54-497e-897f-86c5021e0d6b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:55.392800 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-cced95aa-7e54-497e-897f-86c5021e0d6b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1522 microversion: 2.1 time: 0.960575 Apr 15 19:53:55.395893 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 144/286] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:54 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1522 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:55.409835 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b50e49e6-4059-4528-8d3d-fabc038badda tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:55.410523 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b50e49e6-4059-4528-8d3d-fabc038badda tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:55.430749 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b50e49e6-4059-4528-8d3d-fabc038badda tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:55.431264 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b50e49e6-4059-4528-8d3d-fabc038badda tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:55.432185 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b50e49e6-4059-4528-8d3d-fabc038badda tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:55.432682 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b50e49e6-4059-4528-8d3d-fabc038badda tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:55.518137 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-3974146d-aa2b-4b7e-acca-5f36cfcc5820 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28505 microversion: 2.20 time: 0.202208 Apr 15 19:53:55.518982 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 143/287] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:53:55 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28505 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:53:55.597699 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-509886fd-3ce1-454e-902a-ed04b962caf8 req-a487ba64-4f62-412f-b13f-38ee1b35ab92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ac93376-e982-4a6d-9b4a-f647bc2169ea", "name": "network-vif-plugged", "status": "completed", "tag": "9de8e0f3-45b4-4d41-bae6-d5eaaae4abc0"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:55.599707 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:53:55.599707 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:53:55.610233 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-509886fd-3ce1-454e-902a-ed04b962caf8 req-a487ba64-4f62-412f-b13f-38ee1b35ab92 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:55.610899 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-509886fd-3ce1-454e-902a-ed04b962caf8 req-a487ba64-4f62-412f-b13f-38ee1b35ab92 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:55.628012 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b50e49e6-4059-4528-8d3d-fabc038badda tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:55.638116 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-509886fd-3ce1-454e-902a-ed04b962caf8 req-a487ba64-4f62-412f-b13f-38ee1b35ab92 service nova] Creating event network-vif-plugged:9de8e0f3-45b4-4d41-bae6-d5eaaae4abc0 for instance 2ac93376-e982-4a6d-9b4a-f647bc2169ea on hv-cinder-78638 Apr 15 19:53:55.656121 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-509886fd-3ce1-454e-902a-ed04b962caf8 req-a487ba64-4f62-412f-b13f-38ee1b35ab92 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064121 Apr 15 19:53:55.656906 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 144/288] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:53:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:53:55.659232 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b50e49e6-4059-4528-8d3d-fabc038badda tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1295 microversion: 2.1 time: 0.260438 Apr 15 19:53:55.661209 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 145/289] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:55 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1295 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:56.329219 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-1fbceb0b-0d9f-491a-8c1e-3d38ef156535 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:56.330658 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-1fbceb0b-0d9f-491a-8c1e-3d38ef156535 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 2ac93376-e982-4a6d-9b4a-f647bc2169ea] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:56.339565 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1fbceb0b-0d9f-491a-8c1e-3d38ef156535 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:56.340392 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1fbceb0b-0d9f-491a-8c1e-3d38ef156535 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:56.341950 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1fbceb0b-0d9f-491a-8c1e-3d38ef156535 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:56.342648 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1fbceb0b-0d9f-491a-8c1e-3d38ef156535 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:56.413049 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-df49b2d6-2082-4d66-8778-2527a3fa7e7b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:56.413535 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-df49b2d6-2082-4d66-8778-2527a3fa7e7b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:56.440362 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-df49b2d6-2082-4d66-8778-2527a3fa7e7b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:56.440867 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-df49b2d6-2082-4d66-8778-2527a3fa7e7b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:56.441723 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-df49b2d6-2082-4d66-8778-2527a3fa7e7b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:56.442217 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-df49b2d6-2082-4d66-8778-2527a3fa7e7b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:57.112157 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-1fbceb0b-0d9f-491a-8c1e-3d38ef156535 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad166de2fea5478da2666ade77017cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6584985c15cf4f69b1ece814924ddc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:57.123627 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-1fbceb0b-0d9f-491a-8c1e-3d38ef156535 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/2ac93376-e982-4a6d-9b4a-f647bc2169ea" status: 200 len: 1313 microversion: 2.1 time: 0.801351 Apr 15 19:53:57.125915 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 145/290] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:56 2021] GET /compute/v2.1/servers/2ac93376-e982-4a6d-9b4a-f647bc2169ea => generated 1313 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:57.131110 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7332a0ea-252c-4053-ad6a-ee8dd4826b53 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:57.132377 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7332a0ea-252c-4053-ad6a-ee8dd4826b53 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:57.146135 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7332a0ea-252c-4053-ad6a-ee8dd4826b53 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:57.146833 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7332a0ea-252c-4053-ad6a-ee8dd4826b53 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:57.147699 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7332a0ea-252c-4053-ad6a-ee8dd4826b53 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:57.148332 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7332a0ea-252c-4053-ad6a-ee8dd4826b53 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:57.186018 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-df49b2d6-2082-4d66-8778-2527a3fa7e7b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:57.202323 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-df49b2d6-2082-4d66-8778-2527a3fa7e7b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1522 microversion: 2.1 time: 0.793545 Apr 15 19:53:57.202965 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 146/291] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:56 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1522 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:57.211517 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d2021baf-38a2-4b32-9eb4-fc2521fb0cb5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:57.211517 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d2021baf-38a2-4b32-9eb4-fc2521fb0cb5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:57.217982 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d2021baf-38a2-4b32-9eb4-fc2521fb0cb5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:57.218495 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d2021baf-38a2-4b32-9eb4-fc2521fb0cb5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:57.219515 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d2021baf-38a2-4b32-9eb4-fc2521fb0cb5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:57.220019 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d2021baf-38a2-4b32-9eb4-fc2521fb0cb5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:57.344783 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7332a0ea-252c-4053-ad6a-ee8dd4826b53 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28630 microversion: 2.20 time: 0.217209 Apr 15 19:53:57.345693 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 146/292] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:53:57 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28630 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:53:57.978408 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d2021baf-38a2-4b32-9eb4-fc2521fb0cb5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:57.987891 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d2021baf-38a2-4b32-9eb4-fc2521fb0cb5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1362 microversion: 2.1 time: 0.783180 Apr 15 19:53:57.988613 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 147/293] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:57 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1362 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:58.144639 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a354cda0-bcf3-42d1-9f83-907d82432a6f tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:58.146438 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a354cda0-bcf3-42d1-9f83-907d82432a6f tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 2ac93376-e982-4a6d-9b4a-f647bc2169ea] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:58.159299 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a354cda0-bcf3-42d1-9f83-907d82432a6f tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:58.159795 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a354cda0-bcf3-42d1-9f83-907d82432a6f tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:58.161153 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a354cda0-bcf3-42d1-9f83-907d82432a6f tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:58.161800 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a354cda0-bcf3-42d1-9f83-907d82432a6f tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:58.225565 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6c323b89-946c-428d-8b52-acffc7c4c911 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:58.226463 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6c323b89-946c-428d-8b52-acffc7c4c911 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:58.242973 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6c323b89-946c-428d-8b52-acffc7c4c911 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:58.244412 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6c323b89-946c-428d-8b52-acffc7c4c911 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:58.245430 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6c323b89-946c-428d-8b52-acffc7c4c911 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:58.246070 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6c323b89-946c-428d-8b52-acffc7c4c911 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:58.757457 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a354cda0-bcf3-42d1-9f83-907d82432a6f tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad166de2fea5478da2666ade77017cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6584985c15cf4f69b1ece814924ddc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:58.766841 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a354cda0-bcf3-42d1-9f83-907d82432a6f tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/2ac93376-e982-4a6d-9b4a-f647bc2169ea" status: 200 len: 1497 microversion: 2.1 time: 0.628126 Apr 15 19:53:58.767606 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 147/294] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:58 2021] GET /compute/v2.1/servers/2ac93376-e982-4a6d-9b4a-f647bc2169ea => generated 1497 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:58.776430 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b46ae6b0-a37d-4bdc-a731-d786d19f0859 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:58.776430 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b46ae6b0-a37d-4bdc-a731-d786d19f0859 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:58.781964 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b46ae6b0-a37d-4bdc-a731-d786d19f0859 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:58.782595 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b46ae6b0-a37d-4bdc-a731-d786d19f0859 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:58.783900 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b46ae6b0-a37d-4bdc-a731-d786d19f0859 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:58.784951 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b46ae6b0-a37d-4bdc-a731-d786d19f0859 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:58.798621 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-6c323b89-946c-428d-8b52-acffc7c4c911 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:58.810783 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6c323b89-946c-428d-8b52-acffc7c4c911 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1522 microversion: 2.1 time: 0.589111 Apr 15 19:53:58.814186 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 148/295] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:58 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1522 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:58.931410 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b46ae6b0-a37d-4bdc-a731-d786d19f0859 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28671 microversion: 2.20 time: 0.149136 Apr 15 19:53:58.932273 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 148/296] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:53:58 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28671 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:53:59.007091 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f6b30209-5453-49e6-b263-b7a6afda00cc tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:59.008407 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f6b30209-5453-49e6-b263-b7a6afda00cc tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:59.017613 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f6b30209-5453-49e6-b263-b7a6afda00cc tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:59.018338 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f6b30209-5453-49e6-b263-b7a6afda00cc tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:59.019383 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f6b30209-5453-49e6-b263-b7a6afda00cc tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:59.020345 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f6b30209-5453-49e6-b263-b7a6afda00cc tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:59.108612 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-4c8d2243-d81d-4f4f-ace3-b4b4f451a317 req-1d624b87-7ae8-4ac2-bb79-ab26b8fb9485 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "271550cc-6d60-4503-9d82-cbf32efbd5d9", "tag": "35f3d958-e117-4a5d-bd05-1e95267c5815"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:53:59.110435 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:53:59.110435 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:53:59.137587 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-4c8d2243-d81d-4f4f-ace3-b4b4f451a317 req-1d624b87-7ae8-4ac2-bb79-ab26b8fb9485 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:59.140514 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-4c8d2243-d81d-4f4f-ace3-b4b4f451a317 req-1d624b87-7ae8-4ac2-bb79-ab26b8fb9485 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:59.177370 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-4c8d2243-d81d-4f4f-ace3-b4b4f451a317 req-1d624b87-7ae8-4ac2-bb79-ab26b8fb9485 service nova] Creating event network-changed:35f3d958-e117-4a5d-bd05-1e95267c5815 for instance 271550cc-6d60-4503-9d82-cbf32efbd5d9 on hv-cinder-78638 Apr 15 19:53:59.189879 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-4c8d2243-d81d-4f4f-ace3-b4b4f451a317 req-1d624b87-7ae8-4ac2-bb79-ab26b8fb9485 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086404 Apr 15 19:53:59.190901 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 149/297] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:53:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:53:59.579035 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f6b30209-5453-49e6-b263-b7a6afda00cc tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:53:59.588734 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f6b30209-5453-49e6-b263-b7a6afda00cc tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1362 microversion: 2.1 time: 0.586535 Apr 15 19:53:59.589594 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 149/298] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:59 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1362 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:53:59.829805 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9f91d812-fa83-4230-a191-34ff6f0ef495 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:59.831127 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9f91d812-fa83-4230-a191-34ff6f0ef495 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:59.840135 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9f91d812-fa83-4230-a191-34ff6f0ef495 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:59.841244 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9f91d812-fa83-4230-a191-34ff6f0ef495 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:59.842360 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9f91d812-fa83-4230-a191-34ff6f0ef495 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:59.842963 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9f91d812-fa83-4230-a191-34ff6f0ef495 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:59.855268 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-fde57a6d-df2b-4320-8c54-2985a96f516a tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:53:59.856090 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-fde57a6d-df2b-4320-8c54-2985a96f516a tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 2ac93376-e982-4a6d-9b4a-f647bc2169ea] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:53:59.874804 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fde57a6d-df2b-4320-8c54-2985a96f516a tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:59.875379 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fde57a6d-df2b-4320-8c54-2985a96f516a tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:59.876245 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fde57a6d-df2b-4320-8c54-2985a96f516a tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:53:59.876739 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fde57a6d-df2b-4320-8c54-2985a96f516a tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:53:59.960072 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-fde57a6d-df2b-4320-8c54-2985a96f516a tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 2ac93376-e982-4a6d-9b4a-f647bc2169ea] Going to try to terminate instance {{(pid=99511) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 15 19:54:00.097658 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-fde57a6d-df2b-4320-8c54-2985a96f516a tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2ac93376-e982-4a6d-9b4a-f647bc2169ea" status: 204 len: 0 microversion: 2.1 time: 0.245901 Apr 15 19:54:00.098682 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 150/299] 10.222.0.58 () {58 vars in 1229 bytes} [Thu Apr 15 19:53:59 2021] DELETE /compute/v2.1/servers/2ac93376-e982-4a6d-9b4a-f647bc2169ea => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 15 19:54:00.105005 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-211f44aa-0e96-497f-bc19-24f418ba68c1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:00.106313 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-211f44aa-0e96-497f-bc19-24f418ba68c1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:00.114918 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-211f44aa-0e96-497f-bc19-24f418ba68c1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:00.115442 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-211f44aa-0e96-497f-bc19-24f418ba68c1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:00.116506 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-211f44aa-0e96-497f-bc19-24f418ba68c1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:00.117001 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-211f44aa-0e96-497f-bc19-24f418ba68c1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:00.228495 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9f91d812-fa83-4230-a191-34ff6f0ef495 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:00.243257 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9f91d812-fa83-4230-a191-34ff6f0ef495 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1522 microversion: 2.1 time: 0.418453 Apr 15 19:54:00.245768 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 150/300] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:53:59 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1522 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:54:00.258489 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-dcc405fe-3e75-4acf-88cb-ec0da54bc37a tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:00.259177 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-dcc405fe-3e75-4acf-88cb-ec0da54bc37a tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 2ac93376-e982-4a6d-9b4a-f647bc2169ea] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:00.267150 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dcc405fe-3e75-4acf-88cb-ec0da54bc37a tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:00.267914 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dcc405fe-3e75-4acf-88cb-ec0da54bc37a tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:00.268942 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dcc405fe-3e75-4acf-88cb-ec0da54bc37a tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:00.269628 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dcc405fe-3e75-4acf-88cb-ec0da54bc37a tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:00.663247 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-dcc405fe-3e75-4acf-88cb-ec0da54bc37a tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad166de2fea5478da2666ade77017cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6584985c15cf4f69b1ece814924ddc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:00.672907 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-dcc405fe-3e75-4acf-88cb-ec0da54bc37a tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/2ac93376-e982-4a6d-9b4a-f647bc2169ea" status: 200 len: 1503 microversion: 2.1 time: 0.425730 Apr 15 19:54:00.673795 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 151/301] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:00 2021] GET /compute/v2.1/servers/2ac93376-e982-4a6d-9b4a-f647bc2169ea => generated 1503 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:54:00.687396 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-43b7acab-4438-4ba4-8782-719fabb54871 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:00.689232 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-43b7acab-4438-4ba4-8782-719fabb54871 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:00.697711 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-43b7acab-4438-4ba4-8782-719fabb54871 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:00.698350 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-43b7acab-4438-4ba4-8782-719fabb54871 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:00.699389 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-43b7acab-4438-4ba4-8782-719fabb54871 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:00.699942 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-43b7acab-4438-4ba4-8782-719fabb54871 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:00.786055 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-211f44aa-0e96-497f-bc19-24f418ba68c1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28671 microversion: 2.20 time: 0.685609 Apr 15 19:54:00.787670 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 151/302] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:54:00 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28671 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:54:01.262790 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c8561205-036f-455e-a6f7-5bbdb4417fba tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:01.263715 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c8561205-036f-455e-a6f7-5bbdb4417fba tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:01.278491 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c8561205-036f-455e-a6f7-5bbdb4417fba tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:01.279007 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c8561205-036f-455e-a6f7-5bbdb4417fba tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:01.279890 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c8561205-036f-455e-a6f7-5bbdb4417fba tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:01.280384 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c8561205-036f-455e-a6f7-5bbdb4417fba tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:01.443096 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-43b7acab-4438-4ba4-8782-719fabb54871 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:01.460238 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-43b7acab-4438-4ba4-8782-719fabb54871 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1362 microversion: 2.1 time: 0.785203 Apr 15 19:54:01.460866 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 152/303] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:00 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1362 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:54:01.692792 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f1d38aa0-61fe-4c99-b47d-613695efc9ca tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:01.693743 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f1d38aa0-61fe-4c99-b47d-613695efc9ca tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 2ac93376-e982-4a6d-9b4a-f647bc2169ea] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:01.708205 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f1d38aa0-61fe-4c99-b47d-613695efc9ca tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:01.711829 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f1d38aa0-61fe-4c99-b47d-613695efc9ca tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:01.717422 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f1d38aa0-61fe-4c99-b47d-613695efc9ca tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:01.718128 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f1d38aa0-61fe-4c99-b47d-613695efc9ca tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:01.770446 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c8561205-036f-455e-a6f7-5bbdb4417fba tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:01.780301 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c8561205-036f-455e-a6f7-5bbdb4417fba tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1522 microversion: 2.1 time: 0.521919 Apr 15 19:54:01.780919 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 152/304] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:01 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1522 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:54:01.798906 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a69575dd-7da9-493d-b9c7-1b6b2cf21938 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:01.800163 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a69575dd-7da9-493d-b9c7-1b6b2cf21938 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:01.815600 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a69575dd-7da9-493d-b9c7-1b6b2cf21938 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:01.816114 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a69575dd-7da9-493d-b9c7-1b6b2cf21938 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:01.817837 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a69575dd-7da9-493d-b9c7-1b6b2cf21938 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:01.818348 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a69575dd-7da9-493d-b9c7-1b6b2cf21938 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:02.028718 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f1d38aa0-61fe-4c99-b47d-613695efc9ca tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad166de2fea5478da2666ade77017cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6584985c15cf4f69b1ece814924ddc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:02.038159 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f1d38aa0-61fe-4c99-b47d-613695efc9ca tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/2ac93376-e982-4a6d-9b4a-f647bc2169ea" status: 200 len: 1503 microversion: 2.1 time: 0.350659 Apr 15 19:54:02.038776 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 153/305] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:01 2021] GET /compute/v2.1/servers/2ac93376-e982-4a6d-9b4a-f647bc2169ea => generated 1503 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:54:02.176209 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a69575dd-7da9-493d-b9c7-1b6b2cf21938 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28671 microversion: 2.20 time: 0.381255 Apr 15 19:54:02.177038 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 153/306] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:54:01 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28671 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 15 19:54:02.478174 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-187d2d2c-e2ca-4ea0-96c0-9498c68aab99 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:02.479146 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-187d2d2c-e2ca-4ea0-96c0-9498c68aab99 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:02.488030 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-187d2d2c-e2ca-4ea0-96c0-9498c68aab99 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:02.488751 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-187d2d2c-e2ca-4ea0-96c0-9498c68aab99 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:02.489579 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-187d2d2c-e2ca-4ea0-96c0-9498c68aab99 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:02.490262 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-187d2d2c-e2ca-4ea0-96c0-9498c68aab99 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:02.800232 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-bdca1ac7-eef7-4827-9652-fda8bdf414ba tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:02.800994 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-bdca1ac7-eef7-4827-9652-fda8bdf414ba tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:02.809175 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bdca1ac7-eef7-4827-9652-fda8bdf414ba tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:02.809691 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bdca1ac7-eef7-4827-9652-fda8bdf414ba tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:02.810537 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bdca1ac7-eef7-4827-9652-fda8bdf414ba tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:02.811033 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bdca1ac7-eef7-4827-9652-fda8bdf414ba tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:03.097811 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-187d2d2c-e2ca-4ea0-96c0-9498c68aab99 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:03.113441 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-187d2d2c-e2ca-4ea0-96c0-9498c68aab99 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1362 microversion: 2.1 time: 0.636401 Apr 15 19:54:03.114106 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 154/307] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:02 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1362 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:54:03.120470 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-2fdf5123-907a-47fb-a876-c32afa180df6 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:03.121378 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-2fdf5123-907a-47fb-a876-c32afa180df6 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 2ac93376-e982-4a6d-9b4a-f647bc2169ea] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:03.136793 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2fdf5123-907a-47fb-a876-c32afa180df6 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:03.137283 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2fdf5123-907a-47fb-a876-c32afa180df6 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:03.138271 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2fdf5123-907a-47fb-a876-c32afa180df6 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:03.138904 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2fdf5123-907a-47fb-a876-c32afa180df6 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:03.454655 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-bdca1ac7-eef7-4827-9652-fda8bdf414ba tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:03.466239 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-bdca1ac7-eef7-4827-9652-fda8bdf414ba tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1522 microversion: 2.1 time: 0.671729 Apr 15 19:54:03.467821 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 154/308] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:02 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1522 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:54:03.474337 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-37f585dd-ec33-4731-ac8b-de129465c905 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:03.476168 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-37f585dd-ec33-4731-ac8b-de129465c905 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:03.484927 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-37f585dd-ec33-4731-ac8b-de129465c905 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:03.485421 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-37f585dd-ec33-4731-ac8b-de129465c905 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:03.486574 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-37f585dd-ec33-4731-ac8b-de129465c905 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:03.487078 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-37f585dd-ec33-4731-ac8b-de129465c905 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:03.621699 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-37f585dd-ec33-4731-ac8b-de129465c905 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28671 microversion: 2.20 time: 0.151828 Apr 15 19:54:03.625125 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 155/309] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:54:03 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:54:03.658800 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-2fdf5123-907a-47fb-a876-c32afa180df6 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad166de2fea5478da2666ade77017cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6584985c15cf4f69b1ece814924ddc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:03.682108 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-2fdf5123-907a-47fb-a876-c32afa180df6 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/2ac93376-e982-4a6d-9b4a-f647bc2169ea" status: 200 len: 1503 microversion: 2.1 time: 0.559678 Apr 15 19:54:03.682108 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 155/310] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:03 2021] GET /compute/v2.1/servers/2ac93376-e982-4a6d-9b4a-f647bc2169ea => generated 1503 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:54:03.758209 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-f62d834d-f236-4140-97c3-4ebbc057c0b8 req-653da499-0d72-4e11-bfb5-085c0d15dee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ac93376-e982-4a6d-9b4a-f647bc2169ea", "name": "network-vif-deleted", "tag": "9de8e0f3-45b4-4d41-bae6-d5eaaae4abc0"}]} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:03.759933 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:54:03.759933 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:54:03.769870 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-f62d834d-f236-4140-97c3-4ebbc057c0b8 req-653da499-0d72-4e11-bfb5-085c0d15dee6 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:03.770427 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-f62d834d-f236-4140-97c3-4ebbc057c0b8 req-653da499-0d72-4e11-bfb5-085c0d15dee6 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:03.789747 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-f62d834d-f236-4140-97c3-4ebbc057c0b8 req-653da499-0d72-4e11-bfb5-085c0d15dee6 service nova] Creating event network-vif-deleted:9de8e0f3-45b4-4d41-bae6-d5eaaae4abc0 for instance 2ac93376-e982-4a6d-9b4a-f647bc2169ea on hv-cinder-78638 Apr 15 19:54:03.795595 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-f62d834d-f236-4140-97c3-4ebbc057c0b8 req-653da499-0d72-4e11-bfb5-085c0d15dee6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042595 Apr 15 19:54:03.796244 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 156/311] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:54:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:54:04.131646 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e3111d92-0f5a-480d-b473-cd8a82664759 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:04.132366 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e3111d92-0f5a-480d-b473-cd8a82664759 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:04.140255 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e3111d92-0f5a-480d-b473-cd8a82664759 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:04.141334 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e3111d92-0f5a-480d-b473-cd8a82664759 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:04.142163 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e3111d92-0f5a-480d-b473-cd8a82664759 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:04.142655 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e3111d92-0f5a-480d-b473-cd8a82664759 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:04.355148 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-e3111d92-0f5a-480d-b473-cd8a82664759 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:04.364431 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e3111d92-0f5a-480d-b473-cd8a82664759 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1362 microversion: 2.1 time: 0.236756 Apr 15 19:54:04.365047 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 156/312] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:04 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1362 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:54:04.486556 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-253e6788-3ef5-4085-8022-23c4e6e007ed tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:04.487495 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-253e6788-3ef5-4085-8022-23c4e6e007ed tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:04.495688 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-253e6788-3ef5-4085-8022-23c4e6e007ed tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:04.496182 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-253e6788-3ef5-4085-8022-23c4e6e007ed tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:04.497010 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-253e6788-3ef5-4085-8022-23c4e6e007ed tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:04.497507 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-253e6788-3ef5-4085-8022-23c4e6e007ed tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:04.637534 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-48d28fd0-cf35-440f-9967-a6e33e1d88eb tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:04.638917 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-48d28fd0-cf35-440f-9967-a6e33e1d88eb tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:04.646909 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-48d28fd0-cf35-440f-9967-a6e33e1d88eb tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:04.647470 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-48d28fd0-cf35-440f-9967-a6e33e1d88eb tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:04.648314 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-48d28fd0-cf35-440f-9967-a6e33e1d88eb tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:04.648805 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-48d28fd0-cf35-440f-9967-a6e33e1d88eb tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:04.712082 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-253e6788-3ef5-4085-8022-23c4e6e007ed tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:04.725544 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-253e6788-3ef5-4085-8022-23c4e6e007ed tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1522 microversion: 2.1 time: 0.244189 Apr 15 19:54:04.726456 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 157/313] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:04 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:54:04.732054 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a58b1ed2-21fd-43ec-b3dd-4976a68c3c23 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:04.732846 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a58b1ed2-21fd-43ec-b3dd-4976a68c3c23 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] [instance: 2ac93376-e982-4a6d-9b4a-f647bc2169ea] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:04.744358 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a58b1ed2-21fd-43ec-b3dd-4976a68c3c23 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:04.744941 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a58b1ed2-21fd-43ec-b3dd-4976a68c3c23 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:04.745781 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a58b1ed2-21fd-43ec-b3dd-4976a68c3c23 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:04.746270 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a58b1ed2-21fd-43ec-b3dd-4976a68c3c23 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:04.762265 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-48d28fd0-cf35-440f-9967-a6e33e1d88eb tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28671 microversion: 2.20 time: 0.128648 Apr 15 19:54:04.766733 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 157/314] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:54:04 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28671 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 15 19:54:04.800703 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-a58b1ed2-21fd-43ec-b3dd-4976a68c3c23 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] HTTP exception thrown: Instance 2ac93376-e982-4a6d-9b4a-f647bc2169ea could not be found. Apr 15 19:54:04.801413 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a58b1ed2-21fd-43ec-b3dd-4976a68c3c23 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] Returning 404 to user: Instance 2ac93376-e982-4a6d-9b4a-f647bc2169ea could not be found. {{(pid=99511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 19:54:04.802295 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a58b1ed2-21fd-43ec-b3dd-4976a68c3c23 tempest-VolumesActionsTest-1317049533 tempest-VolumesActionsTest-1317049533-project] 10.222.0.58 "GET /compute/v2.1/servers/2ac93376-e982-4a6d-9b4a-f647bc2169ea" status: 404 len: 111 microversion: 2.1 time: 0.074646 Apr 15 19:54:04.802894 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 158/315] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:04 2021] GET /compute/v2.1/servers/2ac93376-e982-4a6d-9b4a-f647bc2169ea => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 15 19:54:05.382953 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7f1d760f-efe6-428a-9a1f-f1467120321c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:05.383775 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7f1d760f-efe6-428a-9a1f-f1467120321c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:05.392751 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7f1d760f-efe6-428a-9a1f-f1467120321c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:05.393263 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7f1d760f-efe6-428a-9a1f-f1467120321c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:05.394100 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7f1d760f-efe6-428a-9a1f-f1467120321c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:05.394594 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7f1d760f-efe6-428a-9a1f-f1467120321c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:05.611510 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-7f1d760f-efe6-428a-9a1f-f1467120321c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:05.625574 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7f1d760f-efe6-428a-9a1f-f1467120321c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1362 microversion: 2.1 time: 0.246536 Apr 15 19:54:05.626193 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 158/316] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:05 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:54:05.745203 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-430e6211-197b-48d9-947a-ebea42b5657a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:05.746570 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-430e6211-197b-48d9-947a-ebea42b5657a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:05.756636 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-430e6211-197b-48d9-947a-ebea42b5657a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:05.757392 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-430e6211-197b-48d9-947a-ebea42b5657a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:05.758447 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-430e6211-197b-48d9-947a-ebea42b5657a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:05.758990 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-430e6211-197b-48d9-947a-ebea42b5657a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:05.774512 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c2e6b9f1-786f-44c6-be56-2f9ff708be12 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:05.775788 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c2e6b9f1-786f-44c6-be56-2f9ff708be12 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:05.788150 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c2e6b9f1-786f-44c6-be56-2f9ff708be12 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:05.788959 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c2e6b9f1-786f-44c6-be56-2f9ff708be12 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:05.790714 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c2e6b9f1-786f-44c6-be56-2f9ff708be12 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:05.791581 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c2e6b9f1-786f-44c6-be56-2f9ff708be12 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:05.894865 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c2e6b9f1-786f-44c6-be56-2f9ff708be12 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28671 microversion: 2.20 time: 0.124265 Apr 15 19:54:05.895626 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 159/317] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:54:05 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28671 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 15 19:54:05.997866 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-430e6211-197b-48d9-947a-ebea42b5657a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:06.007627 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-430e6211-197b-48d9-947a-ebea42b5657a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1522 microversion: 2.1 time: 0.267032 Apr 15 19:54:06.008238 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 159/318] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:05 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:54:06.645379 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9b4f345d-671b-4456-927c-76369e4a8b55 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:06.646148 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9b4f345d-671b-4456-927c-76369e4a8b55 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:06.654772 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9b4f345d-671b-4456-927c-76369e4a8b55 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:06.655296 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9b4f345d-671b-4456-927c-76369e4a8b55 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:06.656182 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9b4f345d-671b-4456-927c-76369e4a8b55 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:06.657265 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9b4f345d-671b-4456-927c-76369e4a8b55 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:06.875189 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9b4f345d-671b-4456-927c-76369e4a8b55 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:06.884026 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9b4f345d-671b-4456-927c-76369e4a8b55 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1362 microversion: 2.1 time: 0.243733 Apr 15 19:54:06.884641 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 160/319] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:06 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1362 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:54:06.906992 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d4108ea1-91ac-4c31-aa0a-f373b70a4186 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:06.908036 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d4108ea1-91ac-4c31-aa0a-f373b70a4186 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:06.916324 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d4108ea1-91ac-4c31-aa0a-f373b70a4186 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:06.916838 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d4108ea1-91ac-4c31-aa0a-f373b70a4186 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:06.917938 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d4108ea1-91ac-4c31-aa0a-f373b70a4186 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:06.918433 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d4108ea1-91ac-4c31-aa0a-f373b70a4186 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:07.025651 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-804548a3-1768-472f-828d-8c345b830433 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:07.026244 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-804548a3-1768-472f-828d-8c345b830433 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:07.034098 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-804548a3-1768-472f-828d-8c345b830433 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:07.034606 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-804548a3-1768-472f-828d-8c345b830433 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:07.035455 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-804548a3-1768-472f-828d-8c345b830433 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:07.035941 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-804548a3-1768-472f-828d-8c345b830433 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:07.245311 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-804548a3-1768-472f-828d-8c345b830433 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:07.254838 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-804548a3-1768-472f-828d-8c345b830433 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1522 microversion: 2.1 time: 0.233277 Apr 15 19:54:07.255478 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 161/320] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:07 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:54:07.902261 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-fc5539aa-3c42-4bff-b7e6-ae9bec2480ef tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:07.902941 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-fc5539aa-3c42-4bff-b7e6-ae9bec2480ef tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:07.912460 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fc5539aa-3c42-4bff-b7e6-ae9bec2480ef tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:07.912976 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fc5539aa-3c42-4bff-b7e6-ae9bec2480ef tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:07.913822 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fc5539aa-3c42-4bff-b7e6-ae9bec2480ef tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:07.914320 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fc5539aa-3c42-4bff-b7e6-ae9bec2480ef tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:08.129810 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-fc5539aa-3c42-4bff-b7e6-ae9bec2480ef tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:08.138620 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-fc5539aa-3c42-4bff-b7e6-ae9bec2480ef tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1362 microversion: 2.1 time: 0.240443 Apr 15 19:54:08.139241 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 162/321] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:07 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1362 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:54:08.187026 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-32d5f3e4-4262-4d5f-8c2f-289ca46afee3 req-63a64a70-47e7-40e3-a62d-908ba6bfe13b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "271550cc-6d60-4503-9d82-cbf32efbd5d9", "name": "network-vif-plugged", "status": "completed", "tag": "35f3d958-e117-4a5d-bd05-1e95267c5815"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:08.188968 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:54:08.188968 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:54:08.197865 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-32d5f3e4-4262-4d5f-8c2f-289ca46afee3 req-63a64a70-47e7-40e3-a62d-908ba6bfe13b service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:08.198363 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-32d5f3e4-4262-4d5f-8c2f-289ca46afee3 req-63a64a70-47e7-40e3-a62d-908ba6bfe13b service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:08.218648 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-32d5f3e4-4262-4d5f-8c2f-289ca46afee3 req-63a64a70-47e7-40e3-a62d-908ba6bfe13b service nova] Creating event network-vif-plugged:35f3d958-e117-4a5d-bd05-1e95267c5815 for instance 271550cc-6d60-4503-9d82-cbf32efbd5d9 on hv-cinder-78638 Apr 15 19:54:08.224327 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-32d5f3e4-4262-4d5f-8c2f-289ca46afee3 req-63a64a70-47e7-40e3-a62d-908ba6bfe13b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041129 Apr 15 19:54:08.224912 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 163/322] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:54:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 15 19:54:08.273568 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b2f9be10-e360-46f4-a98b-a011388d4ae3 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:08.274338 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b2f9be10-e360-46f4-a98b-a011388d4ae3 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:08.282957 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b2f9be10-e360-46f4-a98b-a011388d4ae3 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:08.283502 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b2f9be10-e360-46f4-a98b-a011388d4ae3 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:08.284343 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b2f9be10-e360-46f4-a98b-a011388d4ae3 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:08.284839 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b2f9be10-e360-46f4-a98b-a011388d4ae3 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:08.498080 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b2f9be10-e360-46f4-a98b-a011388d4ae3 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:08.507369 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b2f9be10-e360-46f4-a98b-a011388d4ae3 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1522 microversion: 2.1 time: 0.238351 Apr 15 19:54:08.507995 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 164/323] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:08 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:54:09.157058 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-484bccca-a8da-4e7e-94a5-8624dde762d2 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:09.157759 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-484bccca-a8da-4e7e-94a5-8624dde762d2 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:09.165535 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-484bccca-a8da-4e7e-94a5-8624dde762d2 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:09.166039 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-484bccca-a8da-4e7e-94a5-8624dde762d2 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:09.166858 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-484bccca-a8da-4e7e-94a5-8624dde762d2 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:09.167396 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-484bccca-a8da-4e7e-94a5-8624dde762d2 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:09.378364 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-484bccca-a8da-4e7e-94a5-8624dde762d2 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:09.387035 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-484bccca-a8da-4e7e-94a5-8624dde762d2 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1362 microversion: 2.1 time: 0.234018 Apr 15 19:54:09.387707 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 165/324] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:09 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1362 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:54:09.524772 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-03fee0c4-0f74-4560-83d5-83e6725b4a50 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:09.525476 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-03fee0c4-0f74-4560-83d5-83e6725b4a50 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:09.533504 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-03fee0c4-0f74-4560-83d5-83e6725b4a50 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:09.534004 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-03fee0c4-0f74-4560-83d5-83e6725b4a50 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:09.534826 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-03fee0c4-0f74-4560-83d5-83e6725b4a50 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:09.535332 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-03fee0c4-0f74-4560-83d5-83e6725b4a50 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:09.750224 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-03fee0c4-0f74-4560-83d5-83e6725b4a50 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:09.759159 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-03fee0c4-0f74-4560-83d5-83e6725b4a50 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1522 microversion: 2.1 time: 0.238431 Apr 15 19:54:09.759820 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 166/325] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:09 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:54:10.405162 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-1f4fdae4-d067-4185-baa7-f2d9a909ccd8 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:10.405831 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-1f4fdae4-d067-4185-baa7-f2d9a909ccd8 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:10.414834 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1f4fdae4-d067-4185-baa7-f2d9a909ccd8 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:10.415375 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1f4fdae4-d067-4185-baa7-f2d9a909ccd8 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:10.416209 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1f4fdae4-d067-4185-baa7-f2d9a909ccd8 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:10.416705 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1f4fdae4-d067-4185-baa7-f2d9a909ccd8 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:10.517483 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d4108ea1-91ac-4c31-aa0a-f373b70a4186 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28671 microversion: 2.20 time: 3.614902 Apr 15 19:54:10.519313 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 160/326] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:54:06 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28671 bytes in 3617 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:54:10.638133 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-1f4fdae4-d067-4185-baa7-f2d9a909ccd8 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:10.647771 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-1f4fdae4-d067-4185-baa7-f2d9a909ccd8 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1362 microversion: 2.1 time: 0.246500 Apr 15 19:54:10.648465 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 167/327] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:10 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:54:10.778324 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-19200ac7-f6f2-4cde-adc1-19a8d8733298 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:10.779203 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-19200ac7-f6f2-4cde-adc1-19a8d8733298 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:10.787845 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-19200ac7-f6f2-4cde-adc1-19a8d8733298 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:10.788362 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-19200ac7-f6f2-4cde-adc1-19a8d8733298 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:10.789208 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-19200ac7-f6f2-4cde-adc1-19a8d8733298 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:10.789710 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-19200ac7-f6f2-4cde-adc1-19a8d8733298 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:11.097095 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-19200ac7-f6f2-4cde-adc1-19a8d8733298 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:11.106212 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-19200ac7-f6f2-4cde-adc1-19a8d8733298 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1522 microversion: 2.1 time: 0.332519 Apr 15 19:54:11.106831 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 161/328] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:10 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1522 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:54:11.529690 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-72e85753-98f4-4cbe-b00c-ee98e578e264 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:11.530729 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-72e85753-98f4-4cbe-b00c-ee98e578e264 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:11.539062 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-72e85753-98f4-4cbe-b00c-ee98e578e264 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:11.539619 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-72e85753-98f4-4cbe-b00c-ee98e578e264 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:11.540444 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-72e85753-98f4-4cbe-b00c-ee98e578e264 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:11.540935 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-72e85753-98f4-4cbe-b00c-ee98e578e264 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:11.666165 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-5689da55-2179-4731-aca5-870b97ff91b8 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:11.666765 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-5689da55-2179-4731-aca5-870b97ff91b8 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:11.675443 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5689da55-2179-4731-aca5-870b97ff91b8 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:11.675955 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5689da55-2179-4731-aca5-870b97ff91b8 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:11.676784 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5689da55-2179-4731-aca5-870b97ff91b8 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:11.677270 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5689da55-2179-4731-aca5-870b97ff91b8 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:12.102704 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-5689da55-2179-4731-aca5-870b97ff91b8 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:12.111510 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-5689da55-2179-4731-aca5-870b97ff91b8 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1362 microversion: 2.1 time: 0.449369 Apr 15 19:54:12.112130 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 162/329] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:11 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1362 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:54:12.124402 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-60544c52-1b1d-4be7-a2de-d14d4ead159e tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:12.125111 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-60544c52-1b1d-4be7-a2de-d14d4ead159e tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:12.132591 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-60544c52-1b1d-4be7-a2de-d14d4ead159e tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:12.133298 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-60544c52-1b1d-4be7-a2de-d14d4ead159e tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:12.134139 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-60544c52-1b1d-4be7-a2de-d14d4ead159e tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:12.134638 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-60544c52-1b1d-4be7-a2de-d14d4ead159e tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:12.348192 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-60544c52-1b1d-4be7-a2de-d14d4ead159e tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:12.358096 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-60544c52-1b1d-4be7-a2de-d14d4ead159e tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1522 microversion: 2.1 time: 0.237296 Apr 15 19:54:12.358703 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 163/330] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:12 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:54:13.129447 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-63240da5-f511-45b1-b6c5-585e452f7ce5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:13.130118 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-63240da5-f511-45b1-b6c5-585e452f7ce5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:13.137984 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-63240da5-f511-45b1-b6c5-585e452f7ce5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:13.138495 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-63240da5-f511-45b1-b6c5-585e452f7ce5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:13.139346 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-63240da5-f511-45b1-b6c5-585e452f7ce5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:13.139844 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-63240da5-f511-45b1-b6c5-585e452f7ce5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:13.348509 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-63240da5-f511-45b1-b6c5-585e452f7ce5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:13.357316 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-63240da5-f511-45b1-b6c5-585e452f7ce5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1362 microversion: 2.1 time: 0.232395 Apr 15 19:54:13.357940 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 164/331] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:13 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:54:13.376551 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6098bf91-5e72-41e5-b3b7-c8d1a6179fab tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:13.377219 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6098bf91-5e72-41e5-b3b7-c8d1a6179fab tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:13.384910 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6098bf91-5e72-41e5-b3b7-c8d1a6179fab tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:13.385368 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6098bf91-5e72-41e5-b3b7-c8d1a6179fab tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:13.386271 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6098bf91-5e72-41e5-b3b7-c8d1a6179fab tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:13.386767 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6098bf91-5e72-41e5-b3b7-c8d1a6179fab tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:13.603433 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-6098bf91-5e72-41e5-b3b7-c8d1a6179fab tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:13.612375 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6098bf91-5e72-41e5-b3b7-c8d1a6179fab tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1522 microversion: 2.1 time: 0.240187 Apr 15 19:54:13.612997 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 165/332] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:13 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:54:14.375821 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-dfc9a512-8703-4f06-8009-ad916f4df677 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:14.376437 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-dfc9a512-8703-4f06-8009-ad916f4df677 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:14.384741 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dfc9a512-8703-4f06-8009-ad916f4df677 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:14.385263 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dfc9a512-8703-4f06-8009-ad916f4df677 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:14.386079 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dfc9a512-8703-4f06-8009-ad916f4df677 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:14.386573 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dfc9a512-8703-4f06-8009-ad916f4df677 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:14.598794 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-dfc9a512-8703-4f06-8009-ad916f4df677 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:14.607680 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-dfc9a512-8703-4f06-8009-ad916f4df677 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1362 microversion: 2.1 time: 0.235969 Apr 15 19:54:14.608293 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 166/333] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:14 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:54:14.629861 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c6c81cd8-c7b5-433a-909d-977065e3b25b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:14.630527 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c6c81cd8-c7b5-433a-909d-977065e3b25b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:14.638347 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c6c81cd8-c7b5-433a-909d-977065e3b25b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:14.638854 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c6c81cd8-c7b5-433a-909d-977065e3b25b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:14.639708 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c6c81cd8-c7b5-433a-909d-977065e3b25b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:14.640200 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c6c81cd8-c7b5-433a-909d-977065e3b25b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:14.853315 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c6c81cd8-c7b5-433a-909d-977065e3b25b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:14.862925 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c6c81cd8-c7b5-433a-909d-977065e3b25b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1522 microversion: 2.1 time: 0.236840 Apr 15 19:54:14.863572 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 167/334] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:14 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:54:15.627072 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-1942692b-f3c9-4bbf-8397-e8cacc1c0eff tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:15.627774 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-1942692b-f3c9-4bbf-8397-e8cacc1c0eff tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:15.635900 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1942692b-f3c9-4bbf-8397-e8cacc1c0eff tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:15.636408 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1942692b-f3c9-4bbf-8397-e8cacc1c0eff tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:15.637242 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1942692b-f3c9-4bbf-8397-e8cacc1c0eff tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:15.637709 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1942692b-f3c9-4bbf-8397-e8cacc1c0eff tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:15.854463 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-1942692b-f3c9-4bbf-8397-e8cacc1c0eff tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:15.863776 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-1942692b-f3c9-4bbf-8397-e8cacc1c0eff tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1362 microversion: 2.1 time: 0.241342 Apr 15 19:54:15.864396 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 168/335] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:15 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:54:15.880228 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c445ec53-fb2b-4c59-85b5-ffd60e83ab7c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:15.880885 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c445ec53-fb2b-4c59-85b5-ffd60e83ab7c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:15.888685 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c445ec53-fb2b-4c59-85b5-ffd60e83ab7c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:15.889190 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c445ec53-fb2b-4c59-85b5-ffd60e83ab7c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:15.890019 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c445ec53-fb2b-4c59-85b5-ffd60e83ab7c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:15.890510 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c445ec53-fb2b-4c59-85b5-ffd60e83ab7c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:16.098958 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c445ec53-fb2b-4c59-85b5-ffd60e83ab7c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:16.107787 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c445ec53-fb2b-4c59-85b5-ffd60e83ab7c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1522 microversion: 2.1 time: 0.231136 Apr 15 19:54:16.108395 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 169/336] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:15 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:54:16.306536 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-72e85753-98f4-4cbe-b00c-ee98e578e264 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28671 microversion: 2.20 time: 4.780665 Apr 15 19:54:16.307298 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 168/337] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:54:11 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28671 bytes in 4782 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:54:16.880994 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-42fcfeb4-abaa-4f87-b53f-d26a7a0f0deb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:16.881660 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-42fcfeb4-abaa-4f87-b53f-d26a7a0f0deb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:16.889464 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-42fcfeb4-abaa-4f87-b53f-d26a7a0f0deb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:16.889969 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-42fcfeb4-abaa-4f87-b53f-d26a7a0f0deb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:16.890831 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-42fcfeb4-abaa-4f87-b53f-d26a7a0f0deb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:16.891342 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-42fcfeb4-abaa-4f87-b53f-d26a7a0f0deb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:17.102842 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-42fcfeb4-abaa-4f87-b53f-d26a7a0f0deb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:17.112147 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-42fcfeb4-abaa-4f87-b53f-d26a7a0f0deb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1362 microversion: 2.1 time: 0.235185 Apr 15 19:54:17.112763 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 170/338] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:16 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:54:17.126815 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-480b8e64-692c-41f2-bfd4-f6c1206f041d tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:17.127718 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-480b8e64-692c-41f2-bfd4-f6c1206f041d tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:17.136198 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-480b8e64-692c-41f2-bfd4-f6c1206f041d tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:17.136707 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-480b8e64-692c-41f2-bfd4-f6c1206f041d tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:17.137536 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-480b8e64-692c-41f2-bfd4-f6c1206f041d tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:17.138032 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-480b8e64-692c-41f2-bfd4-f6c1206f041d tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:17.318932 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f29ef438-4681-4f6f-b2c7-338ef7ee2ce0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:17.320472 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f29ef438-4681-4f6f-b2c7-338ef7ee2ce0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:17.329011 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f29ef438-4681-4f6f-b2c7-338ef7ee2ce0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:17.329565 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f29ef438-4681-4f6f-b2c7-338ef7ee2ce0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:17.330410 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f29ef438-4681-4f6f-b2c7-338ef7ee2ce0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:17.330899 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f29ef438-4681-4f6f-b2c7-338ef7ee2ce0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:17.349879 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-480b8e64-692c-41f2-bfd4-f6c1206f041d tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:17.358862 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-480b8e64-692c-41f2-bfd4-f6c1206f041d tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1522 microversion: 2.1 time: 0.236521 Apr 15 19:54:17.359452 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 169/339] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:17 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:54:17.523230 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f29ef438-4681-4f6f-b2c7-338ef7ee2ce0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28671 microversion: 2.20 time: 0.208719 Apr 15 19:54:17.523962 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 171/340] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:54:17 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28671 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 15 19:54:18.132588 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-469e0b57-5656-4c6a-bbc8-503db7288fcb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:18.133263 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-469e0b57-5656-4c6a-bbc8-503db7288fcb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:18.142374 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-469e0b57-5656-4c6a-bbc8-503db7288fcb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:18.142883 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-469e0b57-5656-4c6a-bbc8-503db7288fcb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:18.143755 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-469e0b57-5656-4c6a-bbc8-503db7288fcb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:18.144240 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-469e0b57-5656-4c6a-bbc8-503db7288fcb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:18.370138 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-469e0b57-5656-4c6a-bbc8-503db7288fcb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:18.378390 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-4b874408-8061-4f0a-a632-349f33bc3409 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:18.379526 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-4b874408-8061-4f0a-a632-349f33bc3409 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:18.380618 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-469e0b57-5656-4c6a-bbc8-503db7288fcb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1362 microversion: 2.1 time: 0.252183 Apr 15 19:54:18.381216 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 170/341] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:18 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1362 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:54:18.393080 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4b874408-8061-4f0a-a632-349f33bc3409 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:18.394099 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4b874408-8061-4f0a-a632-349f33bc3409 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:18.395774 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4b874408-8061-4f0a-a632-349f33bc3409 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:18.396627 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4b874408-8061-4f0a-a632-349f33bc3409 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:18.536154 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-2ce7d270-e9df-4514-82d8-70174f9c94f3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:18.537314 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-2ce7d270-e9df-4514-82d8-70174f9c94f3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:18.547919 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2ce7d270-e9df-4514-82d8-70174f9c94f3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:18.548727 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2ce7d270-e9df-4514-82d8-70174f9c94f3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:18.549773 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2ce7d270-e9df-4514-82d8-70174f9c94f3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:18.550448 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2ce7d270-e9df-4514-82d8-70174f9c94f3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:18.666477 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-4b874408-8061-4f0a-a632-349f33bc3409 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:18.679343 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-4b874408-8061-4f0a-a632-349f33bc3409 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1522 microversion: 2.1 time: 0.306253 Apr 15 19:54:18.680177 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 172/342] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:18 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:54:19.400780 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7c09de75-a81a-4b91-aba0-3db5ab29517c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:19.401768 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7c09de75-a81a-4b91-aba0-3db5ab29517c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:19.410819 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7c09de75-a81a-4b91-aba0-3db5ab29517c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:19.411366 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7c09de75-a81a-4b91-aba0-3db5ab29517c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:19.412369 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7c09de75-a81a-4b91-aba0-3db5ab29517c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:19.412871 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7c09de75-a81a-4b91-aba0-3db5ab29517c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:19.674878 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-7c09de75-a81a-4b91-aba0-3db5ab29517c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:19.686139 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7c09de75-a81a-4b91-aba0-3db5ab29517c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1362 microversion: 2.1 time: 0.290932 Apr 15 19:54:19.687294 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 173/343] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:19 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1362 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:54:19.704371 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-94385cf1-206a-4ec4-9474-d83a28298ee3 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:19.705357 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-94385cf1-206a-4ec4-9474-d83a28298ee3 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:19.717159 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-94385cf1-206a-4ec4-9474-d83a28298ee3 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:19.718015 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-94385cf1-206a-4ec4-9474-d83a28298ee3 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:19.719154 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-94385cf1-206a-4ec4-9474-d83a28298ee3 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:19.719860 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-94385cf1-206a-4ec4-9474-d83a28298ee3 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:19.946533 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-94385cf1-206a-4ec4-9474-d83a28298ee3 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:19.974092 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-94385cf1-206a-4ec4-9474-d83a28298ee3 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1522 microversion: 2.1 time: 0.274100 Apr 15 19:54:19.975043 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 174/344] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:19 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:54:20.706947 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b9d1e966-e30b-4e74-b014-190179c8a105 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:20.707690 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b9d1e966-e30b-4e74-b014-190179c8a105 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:20.715694 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b9d1e966-e30b-4e74-b014-190179c8a105 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:20.716211 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b9d1e966-e30b-4e74-b014-190179c8a105 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:20.717056 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b9d1e966-e30b-4e74-b014-190179c8a105 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:20.717551 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b9d1e966-e30b-4e74-b014-190179c8a105 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:20.949304 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b9d1e966-e30b-4e74-b014-190179c8a105 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:20.965662 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b9d1e966-e30b-4e74-b014-190179c8a105 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1362 microversion: 2.1 time: 0.261409 Apr 15 19:54:20.978646 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 175/345] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:20 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1362 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:54:20.996617 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d7bae87a-368f-404b-8774-57d4c2efe9c8 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:20.997555 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d7bae87a-368f-404b-8774-57d4c2efe9c8 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:21.005673 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d7bae87a-368f-404b-8774-57d4c2efe9c8 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:21.006205 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d7bae87a-368f-404b-8774-57d4c2efe9c8 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:21.007094 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d7bae87a-368f-404b-8774-57d4c2efe9c8 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:21.007639 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d7bae87a-368f-404b-8774-57d4c2efe9c8 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:21.277861 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d7bae87a-368f-404b-8774-57d4c2efe9c8 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:21.289074 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d7bae87a-368f-404b-8774-57d4c2efe9c8 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1522 microversion: 2.1 time: 0.296963 Apr 15 19:54:21.289754 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 176/346] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:20 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:54:21.987126 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-bebfdff3-6b22-485e-9a66-69cd000dcb72 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:21.987749 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-bebfdff3-6b22-485e-9a66-69cd000dcb72 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:21.996955 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bebfdff3-6b22-485e-9a66-69cd000dcb72 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:21.997473 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bebfdff3-6b22-485e-9a66-69cd000dcb72 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:21.998322 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bebfdff3-6b22-485e-9a66-69cd000dcb72 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:21.998801 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bebfdff3-6b22-485e-9a66-69cd000dcb72 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:22.244632 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-bebfdff3-6b22-485e-9a66-69cd000dcb72 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:22.254825 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-bebfdff3-6b22-485e-9a66-69cd000dcb72 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1362 microversion: 2.1 time: 0.272293 Apr 15 19:54:22.255880 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 177/347] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:21 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1362 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:54:22.278449 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-2ce7d270-e9df-4514-82d8-70174f9c94f3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28671 microversion: 2.20 time: 3.746062 Apr 15 19:54:22.280014 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 171/348] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:54:18 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28671 bytes in 3749 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:54:22.313772 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-adce01f9-e791-486a-9014-9e49dc95529d tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:22.314672 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-adce01f9-e791-486a-9014-9e49dc95529d tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:22.332782 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-adce01f9-e791-486a-9014-9e49dc95529d tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:22.333457 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-adce01f9-e791-486a-9014-9e49dc95529d tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:22.334416 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-adce01f9-e791-486a-9014-9e49dc95529d tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:22.334966 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-adce01f9-e791-486a-9014-9e49dc95529d tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:22.665753 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-adce01f9-e791-486a-9014-9e49dc95529d tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:22.677415 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-adce01f9-e791-486a-9014-9e49dc95529d tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1522 microversion: 2.1 time: 0.372591 Apr 15 19:54:22.678269 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 178/349] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:22 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1522 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:54:23.275202 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-dfa90f81-17b8-4a60-879a-d22c4bd3f255 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:23.276867 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-dfa90f81-17b8-4a60-879a-d22c4bd3f255 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:23.293251 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c7025479-eb7b-439e-96f9-56a5ce37860a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:23.295050 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c7025479-eb7b-439e-96f9-56a5ce37860a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:23.299667 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dfa90f81-17b8-4a60-879a-d22c4bd3f255 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:23.301163 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dfa90f81-17b8-4a60-879a-d22c4bd3f255 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:23.303784 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dfa90f81-17b8-4a60-879a-d22c4bd3f255 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:23.304278 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dfa90f81-17b8-4a60-879a-d22c4bd3f255 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:23.317787 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c7025479-eb7b-439e-96f9-56a5ce37860a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:23.318309 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c7025479-eb7b-439e-96f9-56a5ce37860a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:23.319205 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c7025479-eb7b-439e-96f9-56a5ce37860a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:23.323594 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c7025479-eb7b-439e-96f9-56a5ce37860a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:23.489284 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c7025479-eb7b-439e-96f9-56a5ce37860a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28671 microversion: 2.20 time: 0.200839 Apr 15 19:54:23.490049 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 179/350] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:54:23 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28671 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:54:23.654107 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-dfa90f81-17b8-4a60-879a-d22c4bd3f255 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:23.664389 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-dfa90f81-17b8-4a60-879a-d22c4bd3f255 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1546 microversion: 2.1 time: 0.394586 Apr 15 19:54:23.665025 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 172/351] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:23 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1546 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:54:23.688147 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-5e6fab06-01c5-4d72-a664-078f7756e4be tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:23.691313 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-5e6fab06-01c5-4d72-a664-078f7756e4be tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:23.697567 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-bbcd9e37-5989-4547-af19-4c00b9ff38db tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:23.698504 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-bbcd9e37-5989-4547-af19-4c00b9ff38db tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:23.701002 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5e6fab06-01c5-4d72-a664-078f7756e4be tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:23.701518 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5e6fab06-01c5-4d72-a664-078f7756e4be tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:23.702677 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5e6fab06-01c5-4d72-a664-078f7756e4be tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:23.703175 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5e6fab06-01c5-4d72-a664-078f7756e4be tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:23.719427 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bbcd9e37-5989-4547-af19-4c00b9ff38db tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:23.720253 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bbcd9e37-5989-4547-af19-4c00b9ff38db tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:23.721313 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bbcd9e37-5989-4547-af19-4c00b9ff38db tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:23.722125 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bbcd9e37-5989-4547-af19-4c00b9ff38db tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:24.098332 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-5e6fab06-01c5-4d72-a664-078f7756e4be tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.418899 Apr 15 19:54:24.099388 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 180/352] 10.222.0.58 () {58 vars in 1265 bytes} [Thu Apr 15 19:54:23 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/os-interface => generated 284 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:54:24.170471 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-bbcd9e37-5989-4547-af19-4c00b9ff38db tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:24.182760 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-bbcd9e37-5989-4547-af19-4c00b9ff38db tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1522 microversion: 2.1 time: 0.489729 Apr 15 19:54:24.184177 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 173/353] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:23 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1522 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:54:24.502717 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c4716ae3-4f9e-4660-a52f-3de8a96e8586 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:24.503790 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c4716ae3-4f9e-4660-a52f-3de8a96e8586 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:24.511588 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c4716ae3-4f9e-4660-a52f-3de8a96e8586 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:24.512097 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c4716ae3-4f9e-4660-a52f-3de8a96e8586 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:24.512937 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c4716ae3-4f9e-4660-a52f-3de8a96e8586 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:24.513430 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c4716ae3-4f9e-4660-a52f-3de8a96e8586 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:25.201073 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-5c3686ef-c62f-4fff-96ad-490684f102ab tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:25.201748 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-5c3686ef-c62f-4fff-96ad-490684f102ab tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:25.210363 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5c3686ef-c62f-4fff-96ad-490684f102ab tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:25.210875 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5c3686ef-c62f-4fff-96ad-490684f102ab tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:25.211752 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5c3686ef-c62f-4fff-96ad-490684f102ab tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:25.212257 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5c3686ef-c62f-4fff-96ad-490684f102ab tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:25.429759 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-5c3686ef-c62f-4fff-96ad-490684f102ab tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:25.438785 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-5c3686ef-c62f-4fff-96ad-490684f102ab tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1522 microversion: 2.1 time: 0.241769 Apr 15 19:54:25.439433 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 174/354] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:25 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:54:26.032460 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9fd705ed-5aca-4e03-b37a-1162d5c6412b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:26.033499 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9fd705ed-5aca-4e03-b37a-1162d5c6412b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:26.041194 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9fd705ed-5aca-4e03-b37a-1162d5c6412b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:26.041695 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9fd705ed-5aca-4e03-b37a-1162d5c6412b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:26.042782 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9fd705ed-5aca-4e03-b37a-1162d5c6412b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:26.043308 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9fd705ed-5aca-4e03-b37a-1162d5c6412b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:27.598230 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c4716ae3-4f9e-4660-a52f-3de8a96e8586 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28671 microversion: 2.20 time: 3.099782 Apr 15 19:54:27.602304 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 181/355] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:54:24 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28671 bytes in 3102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:54:27.604548 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-8c505cc0-4c5f-4404-bfe7-ab5c83ce0859 req-af1f4aa5-0399-49f9-b9ec-786aa8afc8b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "271550cc-6d60-4503-9d82-cbf32efbd5d9", "tag": "35f3d958-e117-4a5d-bd05-1e95267c5815"}]} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:27.606170 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:54:27.606170 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:54:27.616034 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-8c505cc0-4c5f-4404-bfe7-ab5c83ce0859 req-af1f4aa5-0399-49f9-b9ec-786aa8afc8b3 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:27.616525 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-8c505cc0-4c5f-4404-bfe7-ab5c83ce0859 req-af1f4aa5-0399-49f9-b9ec-786aa8afc8b3 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:27.639574 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9fd705ed-5aca-4e03-b37a-1162d5c6412b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 14 microversion: 2.1 time: 1.610859 Apr 15 19:54:27.643962 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 175/356] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:54:26 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 14 bytes in 1613 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 15 19:54:27.645046 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-8c505cc0-4c5f-4404-bfe7-ab5c83ce0859 req-af1f4aa5-0399-49f9-b9ec-786aa8afc8b3 service nova] Creating event network-changed:35f3d958-e117-4a5d-bd05-1e95267c5815 for instance 271550cc-6d60-4503-9d82-cbf32efbd5d9 on hv-cinder-78638 Apr 15 19:54:27.650037 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9e23f6be-ace6-46c5-ae2e-17d81e0b0354 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:27.650618 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-8c505cc0-4c5f-4404-bfe7-ab5c83ce0859 req-af1f4aa5-0399-49f9-b9ec-786aa8afc8b3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049969 Apr 15 19:54:27.650853 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9e23f6be-ace6-46c5-ae2e-17d81e0b0354 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:27.651474 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 182/357] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:54:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:54:27.661190 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9e23f6be-ace6-46c5-ae2e-17d81e0b0354 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:27.661694 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9e23f6be-ace6-46c5-ae2e-17d81e0b0354 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:27.662582 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9e23f6be-ace6-46c5-ae2e-17d81e0b0354 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:27.663067 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9e23f6be-ace6-46c5-ae2e-17d81e0b0354 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:28.199409 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9e23f6be-ace6-46c5-ae2e-17d81e0b0354 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:28.212525 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9e23f6be-ace6-46c5-ae2e-17d81e0b0354 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1522 microversion: 2.1 time: 0.570112 Apr 15 19:54:28.213404 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 176/358] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:27 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1522 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:54:28.616821 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6252dfd0-4102-472f-934c-2457812c035d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:28.619399 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6252dfd0-4102-472f-934c-2457812c035d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:28.634806 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6252dfd0-4102-472f-934c-2457812c035d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:28.635912 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6252dfd0-4102-472f-934c-2457812c035d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:28.637302 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6252dfd0-4102-472f-934c-2457812c035d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:28.638297 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6252dfd0-4102-472f-934c-2457812c035d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:28.655115 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-39590607-b65f-4ff9-afca-6b8c3ac271b4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:28.657375 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-39590607-b65f-4ff9-afca-6b8c3ac271b4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:28.671470 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-39590607-b65f-4ff9-afca-6b8c3ac271b4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:28.672425 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-39590607-b65f-4ff9-afca-6b8c3ac271b4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:28.674763 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-39590607-b65f-4ff9-afca-6b8c3ac271b4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:28.675626 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-39590607-b65f-4ff9-afca-6b8c3ac271b4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:28.823631 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-39590607-b65f-4ff9-afca-6b8c3ac271b4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 14 microversion: 2.1 time: 0.175497 Apr 15 19:54:28.824539 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 177/359] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:54:28 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 14 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 15 19:54:28.825266 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6252dfd0-4102-472f-934c-2457812c035d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28671 microversion: 2.20 time: 0.217017 Apr 15 19:54:28.826394 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 183/360] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:54:28 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28671 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:54:29.232171 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b90977f1-0dd3-4d2c-959d-277fe14c9b02 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:29.232979 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b90977f1-0dd3-4d2c-959d-277fe14c9b02 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:29.242411 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b90977f1-0dd3-4d2c-959d-277fe14c9b02 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:29.242924 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b90977f1-0dd3-4d2c-959d-277fe14c9b02 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:29.243766 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b90977f1-0dd3-4d2c-959d-277fe14c9b02 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:29.244454 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b90977f1-0dd3-4d2c-959d-277fe14c9b02 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:29.478149 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b90977f1-0dd3-4d2c-959d-277fe14c9b02 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:29.489161 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b90977f1-0dd3-4d2c-959d-277fe14c9b02 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1522 microversion: 2.1 time: 0.261504 Apr 15 19:54:29.489932 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 178/361] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:29 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:54:29.837998 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-484cdb03-9ba0-403f-9e25-01dbcbcf743f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:29.838590 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ec2bfd6f-1961-4126-b410-39965e8bfbed tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:29.839436 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ec2bfd6f-1961-4126-b410-39965e8bfbed tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:29.840235 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-484cdb03-9ba0-403f-9e25-01dbcbcf743f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:29.848512 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ec2bfd6f-1961-4126-b410-39965e8bfbed tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:29.849224 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ec2bfd6f-1961-4126-b410-39965e8bfbed tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:29.850169 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-484cdb03-9ba0-403f-9e25-01dbcbcf743f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:29.850298 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ec2bfd6f-1961-4126-b410-39965e8bfbed tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:29.850516 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ec2bfd6f-1961-4126-b410-39965e8bfbed tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:29.850643 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-484cdb03-9ba0-403f-9e25-01dbcbcf743f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:29.851502 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-484cdb03-9ba0-403f-9e25-01dbcbcf743f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:29.852019 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-484cdb03-9ba0-403f-9e25-01dbcbcf743f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:29.972040 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ec2bfd6f-1961-4126-b410-39965e8bfbed tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28671 microversion: 2.20 time: 0.137406 Apr 15 19:54:29.972862 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 179/362] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:54:29 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28671 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 15 19:54:29.976594 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-484cdb03-9ba0-403f-9e25-01dbcbcf743f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 14 microversion: 2.1 time: 0.144969 Apr 15 19:54:29.977266 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 184/363] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:54:29 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 15 19:54:30.509426 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-416f2763-f928-4edc-9d34-b6d01ef0e148 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:30.510182 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-416f2763-f928-4edc-9d34-b6d01ef0e148 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:30.519596 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-416f2763-f928-4edc-9d34-b6d01ef0e148 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:30.520107 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-416f2763-f928-4edc-9d34-b6d01ef0e148 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:30.520936 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-416f2763-f928-4edc-9d34-b6d01ef0e148 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:30.521423 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-416f2763-f928-4edc-9d34-b6d01ef0e148 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:30.777378 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-416f2763-f928-4edc-9d34-b6d01ef0e148 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:30.788113 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-416f2763-f928-4edc-9d34-b6d01ef0e148 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1502 microversion: 2.1 time: 0.283260 Apr 15 19:54:30.789099 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 180/364] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:30 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1502 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:54:30.807918 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-5fecf1ae-b2ad-47eb-8bc0-b7170fa72d98 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8faf0c16-0b97-4e19-8a37-2da3b61b55bd"}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:30.809235 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-5fecf1ae-b2ad-47eb-8bc0-b7170fa72d98 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:30.818935 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5fecf1ae-b2ad-47eb-8bc0-b7170fa72d98 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:30.819485 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5fecf1ae-b2ad-47eb-8bc0-b7170fa72d98 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:30.820376 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5fecf1ae-b2ad-47eb-8bc0-b7170fa72d98 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:30.821046 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5fecf1ae-b2ad-47eb-8bc0-b7170fa72d98 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:30.890123 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-5fecf1ae-b2ad-47eb-8bc0-b7170fa72d98 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] HTTP exception thrown: Cannot 'attach_volume' instance 4f202f3f-01c9-41c6-842e-ee96f6b40094 while it is in vm_state rescued Apr 15 19:54:30.890806 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-5fecf1ae-b2ad-47eb-8bc0-b7170fa72d98 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Returning 409 to user: Cannot 'attach_volume' instance 4f202f3f-01c9-41c6-842e-ee96f6b40094 while it is in vm_state rescued {{(pid=99511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 19:54:30.891746 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-5fecf1ae-b2ad-47eb-8bc0-b7170fa72d98 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "POST /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.088656 Apr 15 19:54:30.892542 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 185/365] 10.222.0.58 () {60 vars in 1313 bytes} [Thu Apr 15 19:54:30 2021] POST /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094/os-volume_attachments => generated 152 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Apr 15 19:54:30.901753 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-0047ad9a-774c-4ce3-b70b-0d21bc03c16c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:30.902340 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-0047ad9a-774c-4ce3-b70b-0d21bc03c16c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:30.910365 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0047ad9a-774c-4ce3-b70b-0d21bc03c16c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:30.911172 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0047ad9a-774c-4ce3-b70b-0d21bc03c16c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:30.912281 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0047ad9a-774c-4ce3-b70b-0d21bc03c16c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:30.912985 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0047ad9a-774c-4ce3-b70b-0d21bc03c16c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:30.987607 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-aa2b2217-241e-46e6-bcd6-2931702cb340 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:30.988888 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-aa2b2217-241e-46e6-bcd6-2931702cb340 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:31.002159 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-aa2b2217-241e-46e6-bcd6-2931702cb340 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:31.003443 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-aa2b2217-241e-46e6-bcd6-2931702cb340 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:31.005532 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-aa2b2217-241e-46e6-bcd6-2931702cb340 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:31.006387 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-aa2b2217-241e-46e6-bcd6-2931702cb340 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:31.061638 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-0047ad9a-774c-4ce3-b70b-0d21bc03c16c tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "POST /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094/action" status: 202 len: 0 microversion: 2.1 time: 0.163673 Apr 15 19:54:31.062962 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 181/366] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:54:30 2021] POST /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:54:31.072839 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-2386f79c-5983-433a-894a-dfe747cad29b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:31.074536 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-2386f79c-5983-433a-894a-dfe747cad29b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:31.090687 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2386f79c-5983-433a-894a-dfe747cad29b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:31.091511 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2386f79c-5983-433a-894a-dfe747cad29b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:31.092541 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2386f79c-5983-433a-894a-dfe747cad29b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:31.093837 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2386f79c-5983-433a-894a-dfe747cad29b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:31.172379 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-aa2b2217-241e-46e6-bcd6-2931702cb340 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28671 microversion: 2.20 time: 0.190134 Apr 15 19:54:31.173010 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 186/367] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:54:30 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28671 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 15 19:54:31.183684 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-1d214684-d438-448d-8d48-097883ef6380 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:31.185581 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-1d214684-d438-448d-8d48-097883ef6380 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:31.216313 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-2386f79c-5983-433a-894a-dfe747cad29b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 14 microversion: 2.1 time: 0.149235 Apr 15 19:54:31.220429 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 182/368] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:54:31 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 14 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 15 19:54:31.223814 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1d214684-d438-448d-8d48-097883ef6380 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:31.224410 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1d214684-d438-448d-8d48-097883ef6380 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:31.225310 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1d214684-d438-448d-8d48-097883ef6380 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:31.225804 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1d214684-d438-448d-8d48-097883ef6380 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:31.612289 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-1d214684-d438-448d-8d48-097883ef6380 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:31.628699 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-1d214684-d438-448d-8d48-097883ef6380 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1510 microversion: 2.1 time: 0.454121 Apr 15 19:54:31.629854 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 187/369] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:31 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1510 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:54:32.185414 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-5cdf0880-bbf4-49eb-93cc-d10d07e971ad tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:32.192962 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-5cdf0880-bbf4-49eb-93cc-d10d07e971ad tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:32.217696 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5cdf0880-bbf4-49eb-93cc-d10d07e971ad tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:32.224687 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5cdf0880-bbf4-49eb-93cc-d10d07e971ad tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:32.225926 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5cdf0880-bbf4-49eb-93cc-d10d07e971ad tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:32.227857 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5cdf0880-bbf4-49eb-93cc-d10d07e971ad tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:32.233105 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-23157022-ba4e-4e16-acd7-89faef06186d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:32.235629 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-23157022-ba4e-4e16-acd7-89faef06186d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:32.248031 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-23157022-ba4e-4e16-acd7-89faef06186d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:32.248874 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-23157022-ba4e-4e16-acd7-89faef06186d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:32.250210 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-23157022-ba4e-4e16-acd7-89faef06186d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:32.250981 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-23157022-ba4e-4e16-acd7-89faef06186d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:32.377548 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-23157022-ba4e-4e16-acd7-89faef06186d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 7546 microversion: 2.1 time: 0.152472 Apr 15 19:54:32.378818 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 188/370] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:54:32 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 7546 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:54:32.421817 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-5cdf0880-bbf4-49eb-93cc-d10d07e971ad tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28671 microversion: 2.20 time: 0.238305 Apr 15 19:54:32.424500 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 183/371] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:54:32 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28671 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:54:32.650511 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-4fcb18bd-41b7-4283-9909-4c39345fa4c5 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:32.651820 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-4fcb18bd-41b7-4283-9909-4c39345fa4c5 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:32.660856 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4fcb18bd-41b7-4283-9909-4c39345fa4c5 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:32.661601 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4fcb18bd-41b7-4283-9909-4c39345fa4c5 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:32.662455 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4fcb18bd-41b7-4283-9909-4c39345fa4c5 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:32.662953 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4fcb18bd-41b7-4283-9909-4c39345fa4c5 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:32.893469 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-4fcb18bd-41b7-4283-9909-4c39345fa4c5 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:32.903470 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-4fcb18bd-41b7-4283-9909-4c39345fa4c5 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1510 microversion: 2.1 time: 0.257663 Apr 15 19:54:32.904331 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 189/372] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:32 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1510 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:54:33.390579 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-60248375-2ab5-4ed5-b85c-68824de1c2a4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:33.391968 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-60248375-2ab5-4ed5-b85c-68824de1c2a4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:33.401250 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-60248375-2ab5-4ed5-b85c-68824de1c2a4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:33.401756 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-60248375-2ab5-4ed5-b85c-68824de1c2a4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:33.402606 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-60248375-2ab5-4ed5-b85c-68824de1c2a4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:33.403100 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-60248375-2ab5-4ed5-b85c-68824de1c2a4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:33.435322 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d7c2d769-d7bb-48c8-9dc3-f5d7c4397246 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:33.436699 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d7c2d769-d7bb-48c8-9dc3-f5d7c4397246 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:33.445199 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d7c2d769-d7bb-48c8-9dc3-f5d7c4397246 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:33.446002 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d7c2d769-d7bb-48c8-9dc3-f5d7c4397246 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:33.446867 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d7c2d769-d7bb-48c8-9dc3-f5d7c4397246 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:33.447363 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d7c2d769-d7bb-48c8-9dc3-f5d7c4397246 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:33.577741 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-60248375-2ab5-4ed5-b85c-68824de1c2a4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 14127 microversion: 2.1 time: 0.191459 Apr 15 19:54:33.582728 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 184/373] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:54:33 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 14127 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:54:33.687871 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d7c2d769-d7bb-48c8-9dc3-f5d7c4397246 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28671 microversion: 2.20 time: 0.255496 Apr 15 19:54:33.688744 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 190/374] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:54:33 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28671 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 15 19:54:33.926958 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7a1f31f2-1ba2-4cd3-85f4-4fd81d4cc76d tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:33.928124 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7a1f31f2-1ba2-4cd3-85f4-4fd81d4cc76d tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:33.946927 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7a1f31f2-1ba2-4cd3-85f4-4fd81d4cc76d tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:33.947524 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7a1f31f2-1ba2-4cd3-85f4-4fd81d4cc76d tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:33.948389 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7a1f31f2-1ba2-4cd3-85f4-4fd81d4cc76d tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:33.948933 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7a1f31f2-1ba2-4cd3-85f4-4fd81d4cc76d tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:34.246567 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-7a1f31f2-1ba2-4cd3-85f4-4fd81d4cc76d tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:34.260127 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7a1f31f2-1ba2-4cd3-85f4-4fd81d4cc76d tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1510 microversion: 2.1 time: 0.338828 Apr 15 19:54:34.260855 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 185/375] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:33 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1510 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:54:34.590671 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-dedefb4c-f6eb-4eaf-b216-b79023d3564c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:34.591708 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-dedefb4c-f6eb-4eaf-b216-b79023d3564c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:34.600350 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dedefb4c-f6eb-4eaf-b216-b79023d3564c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:34.601064 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dedefb4c-f6eb-4eaf-b216-b79023d3564c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:34.602055 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dedefb4c-f6eb-4eaf-b216-b79023d3564c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:34.602694 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dedefb4c-f6eb-4eaf-b216-b79023d3564c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:34.701255 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-169a3a97-ceea-43a6-aac7-deb856b86a9b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:34.702527 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-169a3a97-ceea-43a6-aac7-deb856b86a9b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:34.711461 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-169a3a97-ceea-43a6-aac7-deb856b86a9b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:34.712145 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-169a3a97-ceea-43a6-aac7-deb856b86a9b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:34.713227 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-169a3a97-ceea-43a6-aac7-deb856b86a9b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:34.713760 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-169a3a97-ceea-43a6-aac7-deb856b86a9b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:34.771632 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-dedefb4c-f6eb-4eaf-b216-b79023d3564c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 17861 microversion: 2.1 time: 0.185383 Apr 15 19:54:34.773958 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 191/376] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:54:34 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 17861 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:54:34.917594 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-169a3a97-ceea-43a6-aac7-deb856b86a9b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28671 microversion: 2.20 time: 0.220191 Apr 15 19:54:34.918425 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 186/377] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:54:34 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28671 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:54:35.280957 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-450c3a92-bf2f-4f75-b151-d5294f66dd28 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:35.281767 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-450c3a92-bf2f-4f75-b151-d5294f66dd28 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:35.301156 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-450c3a92-bf2f-4f75-b151-d5294f66dd28 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:35.302443 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-450c3a92-bf2f-4f75-b151-d5294f66dd28 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:35.303473 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-450c3a92-bf2f-4f75-b151-d5294f66dd28 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:35.305972 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-450c3a92-bf2f-4f75-b151-d5294f66dd28 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:35.744806 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-450c3a92-bf2f-4f75-b151-d5294f66dd28 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:35.755918 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-450c3a92-bf2f-4f75-b151-d5294f66dd28 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1510 microversion: 2.1 time: 0.479676 Apr 15 19:54:35.760274 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 192/378] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:35 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1510 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:54:35.786514 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-de932646-a389-4db1-ad79-61d2a0c476f4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:35.787849 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-de932646-a389-4db1-ad79-61d2a0c476f4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:35.797395 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-de932646-a389-4db1-ad79-61d2a0c476f4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:35.797979 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-de932646-a389-4db1-ad79-61d2a0c476f4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:35.798970 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-de932646-a389-4db1-ad79-61d2a0c476f4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:35.799517 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-de932646-a389-4db1-ad79-61d2a0c476f4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:35.904214 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-de932646-a389-4db1-ad79-61d2a0c476f4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 19342 microversion: 2.1 time: 0.122468 Apr 15 19:54:35.905657 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 187/379] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:54:35 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 19342 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:54:35.930827 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-3128e2d6-43f1-4c79-ad40-ceb90115da29 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:35.932453 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-3128e2d6-43f1-4c79-ad40-ceb90115da29 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:35.944821 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3128e2d6-43f1-4c79-ad40-ceb90115da29 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:35.948612 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3128e2d6-43f1-4c79-ad40-ceb90115da29 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:35.949512 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3128e2d6-43f1-4c79-ad40-ceb90115da29 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:35.950025 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3128e2d6-43f1-4c79-ad40-ceb90115da29 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:36.065958 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-3128e2d6-43f1-4c79-ad40-ceb90115da29 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28671 microversion: 2.20 time: 0.139267 Apr 15 19:54:36.067331 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 193/380] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:54:35 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28671 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:54:36.780693 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7543c096-5433-42a3-9b8a-9e4a064f52a8 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:36.781461 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7543c096-5433-42a3-9b8a-9e4a064f52a8 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:36.793082 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7543c096-5433-42a3-9b8a-9e4a064f52a8 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:36.793793 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7543c096-5433-42a3-9b8a-9e4a064f52a8 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:36.794848 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7543c096-5433-42a3-9b8a-9e4a064f52a8 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:36.795589 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7543c096-5433-42a3-9b8a-9e4a064f52a8 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:36.917842 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-46beabf7-89f3-427b-8c32-95ab40207ab1 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:36.919475 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-46beabf7-89f3-427b-8c32-95ab40207ab1 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:36.931628 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-46beabf7-89f3-427b-8c32-95ab40207ab1 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:36.932432 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-46beabf7-89f3-427b-8c32-95ab40207ab1 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:36.933483 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-46beabf7-89f3-427b-8c32-95ab40207ab1 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:36.934164 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-46beabf7-89f3-427b-8c32-95ab40207ab1 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:37.042396 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-46beabf7-89f3-427b-8c32-95ab40207ab1 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 21519 microversion: 2.1 time: 0.129151 Apr 15 19:54:37.044162 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 194/381] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:54:36 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 21519 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:54:37.077920 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-7543c096-5433-42a3-9b8a-9e4a064f52a8 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:37.079038 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d427fb8d-2870-459a-8deb-5923ea327188 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:37.080549 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d427fb8d-2870-459a-8deb-5923ea327188 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:37.090176 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7543c096-5433-42a3-9b8a-9e4a064f52a8 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1516 microversion: 2.1 time: 0.314042 Apr 15 19:54:37.090861 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d427fb8d-2870-459a-8deb-5923ea327188 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:37.091164 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 188/382] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:36 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1516 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:54:37.091883 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d427fb8d-2870-459a-8deb-5923ea327188 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:37.093450 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d427fb8d-2870-459a-8deb-5923ea327188 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:37.094099 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d427fb8d-2870-459a-8deb-5923ea327188 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:38.054382 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-faf67432-824b-40d7-af20-22533fd84fb7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:38.055496 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-faf67432-824b-40d7-af20-22533fd84fb7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:38.064265 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-faf67432-824b-40d7-af20-22533fd84fb7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:38.064769 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-faf67432-824b-40d7-af20-22533fd84fb7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:38.065590 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-faf67432-824b-40d7-af20-22533fd84fb7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:38.066079 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-faf67432-824b-40d7-af20-22533fd84fb7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:40.870076 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d427fb8d-2870-459a-8deb-5923ea327188 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28671 microversion: 2.20 time: 3.795410 Apr 15 19:54:40.870975 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 195/383] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:54:37 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28671 bytes in 3797 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 15 19:54:40.945760 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-faf67432-824b-40d7-af20-22533fd84fb7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 24896 microversion: 2.1 time: 2.895208 Apr 15 19:54:40.946438 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 189/384] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:54:38 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 24896 bytes in 2897 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 15 19:54:41.882885 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f92bdcf6-7713-47a7-8d17-0012e8236985 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:41.884082 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f92bdcf6-7713-47a7-8d17-0012e8236985 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:41.893186 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f92bdcf6-7713-47a7-8d17-0012e8236985 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:41.893714 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f92bdcf6-7713-47a7-8d17-0012e8236985 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:41.894521 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f92bdcf6-7713-47a7-8d17-0012e8236985 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:41.895011 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f92bdcf6-7713-47a7-8d17-0012e8236985 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:41.959252 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6782957d-6060-4f7c-97e3-babca5ce513b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:41.960496 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6782957d-6060-4f7c-97e3-babca5ce513b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:41.969727 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6782957d-6060-4f7c-97e3-babca5ce513b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:41.970243 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6782957d-6060-4f7c-97e3-babca5ce513b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:41.971089 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6782957d-6060-4f7c-97e3-babca5ce513b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:41.971612 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6782957d-6060-4f7c-97e3-babca5ce513b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:42.006788 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f92bdcf6-7713-47a7-8d17-0012e8236985 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28671 microversion: 2.20 time: 0.128093 Apr 15 19:54:42.007687 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 196/385] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:54:41 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28671 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:54:42.084895 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6782957d-6060-4f7c-97e3-babca5ce513b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 26268 microversion: 2.1 time: 0.129919 Apr 15 19:54:42.085550 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 190/386] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:54:41 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 26268 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 15 19:54:43.019122 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6993bdcf-6e98-448e-95f7-bcf4c9e74aec tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:43.020330 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6993bdcf-6e98-448e-95f7-bcf4c9e74aec tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:43.029140 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6993bdcf-6e98-448e-95f7-bcf4c9e74aec tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:43.029654 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6993bdcf-6e98-448e-95f7-bcf4c9e74aec tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:43.030999 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6993bdcf-6e98-448e-95f7-bcf4c9e74aec tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:43.031517 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6993bdcf-6e98-448e-95f7-bcf4c9e74aec tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:43.104538 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-05933746-a409-46b2-bf38-89b9bba1bb2d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:43.105673 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-05933746-a409-46b2-bf38-89b9bba1bb2d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:43.114765 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-05933746-a409-46b2-bf38-89b9bba1bb2d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:43.115308 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-05933746-a409-46b2-bf38-89b9bba1bb2d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:43.116132 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-05933746-a409-46b2-bf38-89b9bba1bb2d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:43.116625 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-05933746-a409-46b2-bf38-89b9bba1bb2d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:46.502257 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6993bdcf-6e98-448e-95f7-bcf4c9e74aec tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28671 microversion: 2.20 time: 3.487378 Apr 15 19:54:46.502963 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 197/387] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:54:43 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28671 bytes in 3489 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:54:46.517679 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-05933746-a409-46b2-bf38-89b9bba1bb2d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 27780 microversion: 2.1 time: 3.423603 Apr 15 19:54:46.518430 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 191/388] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:54:43 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 27780 bytes in 3426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:54:47.515261 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b7e72114-f482-406e-9780-bef1a6a9cb8d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:47.516671 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b7e72114-f482-406e-9780-bef1a6a9cb8d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:47.525308 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b7e72114-f482-406e-9780-bef1a6a9cb8d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:47.526180 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b7e72114-f482-406e-9780-bef1a6a9cb8d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:47.527226 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b7e72114-f482-406e-9780-bef1a6a9cb8d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:47.527975 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b7e72114-f482-406e-9780-bef1a6a9cb8d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:47.531322 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-99d08e06-8f2b-4e3a-8458-c55b6664bd62 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:47.532459 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-99d08e06-8f2b-4e3a-8458-c55b6664bd62 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:47.541310 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-99d08e06-8f2b-4e3a-8458-c55b6664bd62 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:47.541818 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-99d08e06-8f2b-4e3a-8458-c55b6664bd62 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:47.542892 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-99d08e06-8f2b-4e3a-8458-c55b6664bd62 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:47.543596 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-99d08e06-8f2b-4e3a-8458-c55b6664bd62 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:47.638936 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b7e72114-f482-406e-9780-bef1a6a9cb8d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28671 microversion: 2.20 time: 0.128178 Apr 15 19:54:47.643897 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 198/389] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:54:47 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28671 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:54:47.673065 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-99d08e06-8f2b-4e3a-8458-c55b6664bd62 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 27846 microversion: 2.1 time: 0.146362 Apr 15 19:54:47.673754 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 192/390] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:54:47 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 27846 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:54:48.653776 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-34d89cb4-a031-4eb7-8472-36e816997b86 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:48.655687 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-34d89cb4-a031-4eb7-8472-36e816997b86 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:48.664932 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-34d89cb4-a031-4eb7-8472-36e816997b86 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:48.665635 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-34d89cb4-a031-4eb7-8472-36e816997b86 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:48.666619 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-34d89cb4-a031-4eb7-8472-36e816997b86 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:48.667557 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-34d89cb4-a031-4eb7-8472-36e816997b86 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:48.696447 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-db570aa0-c430-401e-8c42-a46721f24ae9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:48.697562 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-db570aa0-c430-401e-8c42-a46721f24ae9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:48.709648 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-db570aa0-c430-401e-8c42-a46721f24ae9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:48.714687 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-db570aa0-c430-401e-8c42-a46721f24ae9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:48.716244 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-db570aa0-c430-401e-8c42-a46721f24ae9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:48.719825 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-db570aa0-c430-401e-8c42-a46721f24ae9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:48.858007 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-34d89cb4-a031-4eb7-8472-36e816997b86 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28671 microversion: 2.20 time: 0.210329 Apr 15 19:54:48.858895 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 199/391] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:54:48 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28671 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:54:48.866398 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f5a92a59-970f-4f55-ada8-0f942d7b534d tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:48.867334 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f5a92a59-970f-4f55-ada8-0f942d7b534d tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:48.867725 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-db570aa0-c430-401e-8c42-a46721f24ae9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28004 microversion: 2.1 time: 0.186373 Apr 15 19:54:48.868391 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 193/392] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:54:48 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28004 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:54:48.876336 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f5a92a59-970f-4f55-ada8-0f942d7b534d tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:48.876846 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f5a92a59-970f-4f55-ada8-0f942d7b534d tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:48.877696 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f5a92a59-970f-4f55-ada8-0f942d7b534d tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:48.878189 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f5a92a59-970f-4f55-ada8-0f942d7b534d tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:49.106073 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f5a92a59-970f-4f55-ada8-0f942d7b534d tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:49.115009 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f5a92a59-970f-4f55-ada8-0f942d7b534d tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1516 microversion: 2.1 time: 0.254722 Apr 15 19:54:49.115663 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 200/393] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:48 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1516 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:54:49.133364 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-25d9a770-bd19-4f46-b175-3c97c681d644 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12ba5081-3a8a-42e1-a0ac-8cca49ee8062"}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:49.134657 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-25d9a770-bd19-4f46-b175-3c97c681d644 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:49.143660 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-25d9a770-bd19-4f46-b175-3c97c681d644 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:49.144171 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-25d9a770-bd19-4f46-b175-3c97c681d644 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:49.145005 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-25d9a770-bd19-4f46-b175-3c97c681d644 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:49.145498 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-25d9a770-bd19-4f46-b175-3c97c681d644 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:49.526292 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-25d9a770-bd19-4f46-b175-3c97c681d644 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "POST /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.397261 Apr 15 19:54:49.527752 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 194/394] 10.222.0.58 () {60 vars in 1313 bytes} [Thu Apr 15 19:54:49 2021] POST /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094/os-volume_attachments => generated 194 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:54:49.870495 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b5fb3a6d-ac51-4070-a9c8-393558dcf39d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:49.871622 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b5fb3a6d-ac51-4070-a9c8-393558dcf39d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:49.880158 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b5fb3a6d-ac51-4070-a9c8-393558dcf39d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:49.880348 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-44b18a65-80a8-4d87-a47b-8fee606bfd68 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:49.880666 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b5fb3a6d-ac51-4070-a9c8-393558dcf39d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:49.881506 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b5fb3a6d-ac51-4070-a9c8-393558dcf39d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:49.881613 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-44b18a65-80a8-4d87-a47b-8fee606bfd68 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:49.882034 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b5fb3a6d-ac51-4070-a9c8-393558dcf39d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:49.894518 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-44b18a65-80a8-4d87-a47b-8fee606bfd68 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:49.894964 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-44b18a65-80a8-4d87-a47b-8fee606bfd68 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:49.896041 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-44b18a65-80a8-4d87-a47b-8fee606bfd68 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:49.896498 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-44b18a65-80a8-4d87-a47b-8fee606bfd68 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:49.995947 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b5fb3a6d-ac51-4070-a9c8-393558dcf39d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28671 microversion: 2.20 time: 0.129226 Apr 15 19:54:49.997665 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 201/395] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:54:49 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28671 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:54:50.019175 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-44b18a65-80a8-4d87-a47b-8fee606bfd68 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28091 microversion: 2.1 time: 0.142959 Apr 15 19:54:50.020112 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 195/396] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:54:49 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28091 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:54:51.009790 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-0bc9dabf-f443-473d-aa2b-086ee49b1891 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:51.011670 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-0bc9dabf-f443-473d-aa2b-086ee49b1891 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:51.021399 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0bc9dabf-f443-473d-aa2b-086ee49b1891 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:51.022156 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0bc9dabf-f443-473d-aa2b-086ee49b1891 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:51.023187 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0bc9dabf-f443-473d-aa2b-086ee49b1891 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:51.023993 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0bc9dabf-f443-473d-aa2b-086ee49b1891 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:51.032211 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b66608ce-67dd-40d9-a0a7-a2f4843889ac tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:51.033569 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b66608ce-67dd-40d9-a0a7-a2f4843889ac tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:51.053818 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b66608ce-67dd-40d9-a0a7-a2f4843889ac tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:51.056960 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b66608ce-67dd-40d9-a0a7-a2f4843889ac tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:51.057891 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b66608ce-67dd-40d9-a0a7-a2f4843889ac tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:51.058402 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b66608ce-67dd-40d9-a0a7-a2f4843889ac tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:51.166087 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-0bc9dabf-f443-473d-aa2b-086ee49b1891 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28671 microversion: 2.20 time: 0.160403 Apr 15 19:54:51.167655 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 202/397] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:54:51 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28671 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:54:51.221927 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b66608ce-67dd-40d9-a0a7-a2f4843889ac tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28208 microversion: 2.1 time: 0.195167 Apr 15 19:54:51.222880 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 196/398] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:54:51 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28208 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:54:52.180407 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-93cab053-dd5e-45aa-a9e6-988af0fb5584 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:52.182254 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-93cab053-dd5e-45aa-a9e6-988af0fb5584 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:52.191117 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-93cab053-dd5e-45aa-a9e6-988af0fb5584 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:52.191832 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-93cab053-dd5e-45aa-a9e6-988af0fb5584 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:52.192693 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-93cab053-dd5e-45aa-a9e6-988af0fb5584 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:52.193177 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-93cab053-dd5e-45aa-a9e6-988af0fb5584 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:52.236203 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-0008ff74-4a9b-4c58-92c0-53f2e769157e tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:52.237871 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-0008ff74-4a9b-4c58-92c0-53f2e769157e tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:52.283523 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0008ff74-4a9b-4c58-92c0-53f2e769157e tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:52.284036 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0008ff74-4a9b-4c58-92c0-53f2e769157e tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:52.284979 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0008ff74-4a9b-4c58-92c0-53f2e769157e tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:52.285421 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0008ff74-4a9b-4c58-92c0-53f2e769157e tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:52.322225 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-93cab053-dd5e-45aa-a9e6-988af0fb5584 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28671 microversion: 2.20 time: 0.146327 Apr 15 19:54:52.323005 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 203/399] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:54:52 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28671 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:54:52.418999 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-0008ff74-4a9b-4c58-92c0-53f2e769157e tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28208 microversion: 2.1 time: 0.188213 Apr 15 19:54:52.419861 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 197/400] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:54:52 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28208 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 15 19:54:53.335465 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f207ee04-739b-4d51-a94e-fee3e15f9ab9 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:53.337268 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f207ee04-739b-4d51-a94e-fee3e15f9ab9 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:53.347030 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f207ee04-739b-4d51-a94e-fee3e15f9ab9 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:53.347844 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f207ee04-739b-4d51-a94e-fee3e15f9ab9 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:53.348919 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f207ee04-739b-4d51-a94e-fee3e15f9ab9 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:53.349600 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f207ee04-739b-4d51-a94e-fee3e15f9ab9 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:53.435686 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9bed6164-80c0-473f-8e0a-208662fc73d8 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:53.437659 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9bed6164-80c0-473f-8e0a-208662fc73d8 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:53.449966 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9bed6164-80c0-473f-8e0a-208662fc73d8 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:53.450585 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9bed6164-80c0-473f-8e0a-208662fc73d8 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:53.451813 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9bed6164-80c0-473f-8e0a-208662fc73d8 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:53.452662 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9bed6164-80c0-473f-8e0a-208662fc73d8 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:53.464494 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f207ee04-739b-4d51-a94e-fee3e15f9ab9 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28671 microversion: 2.20 time: 0.133293 Apr 15 19:54:53.465177 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 204/401] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:54:53 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28671 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:54:53.581249 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9bed6164-80c0-473f-8e0a-208662fc73d8 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28208 microversion: 2.1 time: 0.153262 Apr 15 19:54:53.582568 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 198/402] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:54:53 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28208 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 15 19:54:54.477644 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-bd4a11b1-4827-49f0-9d92-977daad86c81 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:54.478777 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-bd4a11b1-4827-49f0-9d92-977daad86c81 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:54.487787 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bd4a11b1-4827-49f0-9d92-977daad86c81 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:54.488389 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bd4a11b1-4827-49f0-9d92-977daad86c81 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:54.489237 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bd4a11b1-4827-49f0-9d92-977daad86c81 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:54.489836 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bd4a11b1-4827-49f0-9d92-977daad86c81 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:54.589038 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-bd4a11b1-4827-49f0-9d92-977daad86c81 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28671 microversion: 2.20 time: 0.115928 Apr 15 19:54:54.590503 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 205/403] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:54:54 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28671 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:54:54.595124 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-3c893ca6-7ae5-4449-83e7-bf99b0cbaefb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:54.596289 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-3c893ca6-7ae5-4449-83e7-bf99b0cbaefb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:54.607070 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3c893ca6-7ae5-4449-83e7-bf99b0cbaefb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:54.607520 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3c893ca6-7ae5-4449-83e7-bf99b0cbaefb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:54.608824 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3c893ca6-7ae5-4449-83e7-bf99b0cbaefb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:54.609316 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3c893ca6-7ae5-4449-83e7-bf99b0cbaefb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:54.715002 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-3c893ca6-7ae5-4449-83e7-bf99b0cbaefb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28208 microversion: 2.1 time: 0.124027 Apr 15 19:54:54.716972 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 199/404] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:54:54 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28208 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:54:55.602895 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-da43eb97-81e9-42ac-a830-6fa5edcf06cc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:55.604776 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-da43eb97-81e9-42ac-a830-6fa5edcf06cc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:55.615019 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-da43eb97-81e9-42ac-a830-6fa5edcf06cc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:55.615820 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-da43eb97-81e9-42ac-a830-6fa5edcf06cc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:55.616646 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-da43eb97-81e9-42ac-a830-6fa5edcf06cc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:55.617284 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-da43eb97-81e9-42ac-a830-6fa5edcf06cc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:55.729873 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-53b67da1-c0be-40a6-abc3-87f8ea3b904b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:55.731357 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-53b67da1-c0be-40a6-abc3-87f8ea3b904b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:55.738251 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-da43eb97-81e9-42ac-a830-6fa5edcf06cc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28671 microversion: 2.20 time: 0.139734 Apr 15 19:54:55.739357 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 206/405] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:54:55 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28671 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:54:55.767249 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-53b67da1-c0be-40a6-abc3-87f8ea3b904b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:55.767793 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-53b67da1-c0be-40a6-abc3-87f8ea3b904b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:55.768659 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-53b67da1-c0be-40a6-abc3-87f8ea3b904b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:55.769147 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-53b67da1-c0be-40a6-abc3-87f8ea3b904b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:56.071053 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-53b67da1-c0be-40a6-abc3-87f8ea3b904b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28208 microversion: 2.1 time: 0.345732 Apr 15 19:54:56.072843 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 200/406] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:54:55 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28208 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:54:56.755009 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-654291b6-3986-4bfe-a83c-979eec195fb7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:56.757141 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-654291b6-3986-4bfe-a83c-979eec195fb7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:56.796400 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-654291b6-3986-4bfe-a83c-979eec195fb7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:56.796916 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-654291b6-3986-4bfe-a83c-979eec195fb7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:56.797775 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-654291b6-3986-4bfe-a83c-979eec195fb7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:56.798265 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-654291b6-3986-4bfe-a83c-979eec195fb7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:56.971477 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-654291b6-3986-4bfe-a83c-979eec195fb7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28671 microversion: 2.20 time: 0.223636 Apr 15 19:54:56.972208 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 207/407] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:54:56 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28671 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:54:57.086029 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6732a861-7b13-43c3-aea8-62b0fdf730c4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:57.087554 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6732a861-7b13-43c3-aea8-62b0fdf730c4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:57.102895 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6732a861-7b13-43c3-aea8-62b0fdf730c4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:57.103430 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6732a861-7b13-43c3-aea8-62b0fdf730c4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:57.104280 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6732a861-7b13-43c3-aea8-62b0fdf730c4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:57.104765 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6732a861-7b13-43c3-aea8-62b0fdf730c4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:57.216849 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6732a861-7b13-43c3-aea8-62b0fdf730c4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28208 microversion: 2.1 time: 0.136679 Apr 15 19:54:57.221098 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 201/408] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:54:57 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28208 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:54:57.537620 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-25f441ac-fdf1-4bdf-a0c4-e93791ae84b1 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:57.539188 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-25f441ac-fdf1-4bdf-a0c4-e93791ae84b1 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:57.550108 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-25f441ac-fdf1-4bdf-a0c4-e93791ae84b1 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:57.550817 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-25f441ac-fdf1-4bdf-a0c4-e93791ae84b1 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:57.552214 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-25f441ac-fdf1-4bdf-a0c4-e93791ae84b1 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:57.552858 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-25f441ac-fdf1-4bdf-a0c4-e93791ae84b1 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:57.630244 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.objects.instance [None req-25f441ac-fdf1-4bdf-a0c4-e93791ae84b1 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lazy-loading 'flavor' on Instance uuid 4f202f3f-01c9-41c6-842e-ee96f6b40094 {{(pid=99511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 15 19:54:57.984415 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-84712eb8-2d06-485b-9ae1-121d2828e674 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:57.985580 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-84712eb8-2d06-485b-9ae1-121d2828e674 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:58.004149 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-84712eb8-2d06-485b-9ae1-121d2828e674 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:58.007860 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-84712eb8-2d06-485b-9ae1-121d2828e674 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:58.009051 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-84712eb8-2d06-485b-9ae1-121d2828e674 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:58.009574 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-84712eb8-2d06-485b-9ae1-121d2828e674 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:58.195571 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-84712eb8-2d06-485b-9ae1-121d2828e674 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28671 microversion: 2.20 time: 0.215406 Apr 15 19:54:58.199828 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 202/409] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:54:57 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28671 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:54:58.229987 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f1ca7eba-4220-4bb2-912f-1aff0875e0c0 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:58.231131 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f1ca7eba-4220-4bb2-912f-1aff0875e0c0 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:58.239814 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f1ca7eba-4220-4bb2-912f-1aff0875e0c0 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:58.240610 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f1ca7eba-4220-4bb2-912f-1aff0875e0c0 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:58.241644 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f1ca7eba-4220-4bb2-912f-1aff0875e0c0 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:58.242348 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f1ca7eba-4220-4bb2-912f-1aff0875e0c0 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:58.273275 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-25f441ac-fdf1-4bdf-a0c4-e93791ae84b1 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "POST /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094/action" status: 200 len: 32 microversion: 2.1 time: 0.740693 Apr 15 19:54:58.274104 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 208/410] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:54:57 2021] POST /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094/action => generated 32 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 15 19:54:58.284867 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-0438f6bd-ba48-4808-bb82-34a2574b82b7 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:58.285635 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-0438f6bd-ba48-4808-bb82-34a2574b82b7 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:58.313447 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0438f6bd-ba48-4808-bb82-34a2574b82b7 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:58.314273 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0438f6bd-ba48-4808-bb82-34a2574b82b7 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:58.315345 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0438f6bd-ba48-4808-bb82-34a2574b82b7 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:58.316024 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0438f6bd-ba48-4808-bb82-34a2574b82b7 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:58.356436 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f1ca7eba-4220-4bb2-912f-1aff0875e0c0 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28208 microversion: 2.1 time: 0.130723 Apr 15 19:54:58.358281 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 203/411] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:54:58 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28208 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:54:58.803602 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-0438f6bd-ba48-4808-bb82-34a2574b82b7 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:54:58.816728 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-0438f6bd-ba48-4808-bb82-34a2574b82b7 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1568 microversion: 2.1 time: 0.536357 Apr 15 19:54:58.817897 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 209/412] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:58 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1568 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:54:59.209136 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-deeebb15-e804-463f-b4bf-98660bf537ce tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:59.210874 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-deeebb15-e804-463f-b4bf-98660bf537ce tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:59.241840 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-deeebb15-e804-463f-b4bf-98660bf537ce tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:59.243782 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-deeebb15-e804-463f-b4bf-98660bf537ce tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:59.246698 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-deeebb15-e804-463f-b4bf-98660bf537ce tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:59.250474 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-deeebb15-e804-463f-b4bf-98660bf537ce tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:59.370664 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-733ab9b9-dc54-43e1-9c96-4f402b60f36c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:54:59.372100 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-733ab9b9-dc54-43e1-9c96-4f402b60f36c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:59.395721 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-733ab9b9-dc54-43e1-9c96-4f402b60f36c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:59.396669 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-733ab9b9-dc54-43e1-9c96-4f402b60f36c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:59.399118 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-733ab9b9-dc54-43e1-9c96-4f402b60f36c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:59.401756 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-733ab9b9-dc54-43e1-9c96-4f402b60f36c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:59.440177 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-deeebb15-e804-463f-b4bf-98660bf537ce tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28671 microversion: 2.20 time: 0.235267 Apr 15 19:54:59.441613 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 204/413] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:54:59 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28671 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:54:59.559978 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-733ab9b9-dc54-43e1-9c96-4f402b60f36c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28208 microversion: 2.1 time: 0.194009 Apr 15 19:54:59.564454 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 210/414] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:54:59 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28208 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 15 19:54:59.837181 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7b7eae6d-6105-4a71-a890-c9a3894a97a5 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:54:59.838117 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7b7eae6d-6105-4a71-a890-c9a3894a97a5 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:54:59.856246 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7b7eae6d-6105-4a71-a890-c9a3894a97a5 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:59.856652 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7b7eae6d-6105-4a71-a890-c9a3894a97a5 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:54:59.857533 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7b7eae6d-6105-4a71-a890-c9a3894a97a5 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:54:59.858571 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7b7eae6d-6105-4a71-a890-c9a3894a97a5 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:00.283936 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-7b7eae6d-6105-4a71-a890-c9a3894a97a5 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:00.296769 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7b7eae6d-6105-4a71-a890-c9a3894a97a5 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1568 microversion: 2.1 time: 0.464789 Apr 15 19:55:00.308347 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 205/415] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:54:59 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1568 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:55:00.454043 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-cd2f6cb2-fc1f-40c6-aa4b-28810d424c69 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:00.455562 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-cd2f6cb2-fc1f-40c6-aa4b-28810d424c69 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:00.468127 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cd2f6cb2-fc1f-40c6-aa4b-28810d424c69 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:00.471920 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cd2f6cb2-fc1f-40c6-aa4b-28810d424c69 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:00.472837 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cd2f6cb2-fc1f-40c6-aa4b-28810d424c69 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:00.473317 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cd2f6cb2-fc1f-40c6-aa4b-28810d424c69 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:00.572866 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d90348dd-420d-417e-a060-c94fad3363e4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:00.573936 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d90348dd-420d-417e-a060-c94fad3363e4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:00.583614 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d90348dd-420d-417e-a060-c94fad3363e4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:00.584264 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d90348dd-420d-417e-a060-c94fad3363e4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:00.585180 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d90348dd-420d-417e-a060-c94fad3363e4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:00.585654 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d90348dd-420d-417e-a060-c94fad3363e4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:00.622359 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-cd2f6cb2-fc1f-40c6-aa4b-28810d424c69 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28671 microversion: 2.20 time: 0.172766 Apr 15 19:55:00.623668 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 211/416] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:55:00 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28671 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:55:00.783213 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d90348dd-420d-417e-a060-c94fad3363e4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28208 microversion: 2.1 time: 0.213906 Apr 15 19:55:00.788068 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 206/417] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:00 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28208 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:55:01.318161 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-53392b03-b4f3-4f50-b0eb-b9b4c8da6d40 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:01.319672 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-53392b03-b4f3-4f50-b0eb-b9b4c8da6d40 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:01.344593 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-53392b03-b4f3-4f50-b0eb-b9b4c8da6d40 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:01.345647 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-53392b03-b4f3-4f50-b0eb-b9b4c8da6d40 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:01.347197 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-53392b03-b4f3-4f50-b0eb-b9b4c8da6d40 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:01.348027 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-53392b03-b4f3-4f50-b0eb-b9b4c8da6d40 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:01.442515 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f7f9859e-5ab7-41cf-afd4-d399df860b51 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1739751951", "imageRef": "10d66d6e-f687-4228-93d1-67502c9b42e2", "flavorRef": "452", "networks": [{"uuid": "04ccfe32-3031-4e0e-8687-0a32f699824a"}]}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:01.550851 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.network.neutron [None req-f7f9859e-5ab7-41cf-afd4-d399df860b51 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] validate_networks() for [('04ccfe32-3031-4e0e-8687-0a32f699824a', None, None, None)] {{(pid=99512) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 15 19:55:01.958557 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-53392b03-b4f3-4f50-b0eb-b9b4c8da6d40 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:01.969908 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-53392b03-b4f3-4f50-b0eb-b9b4c8da6d40 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1568 microversion: 2.1 time: 0.656202 Apr 15 19:55:01.970523 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 212/418] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:01 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1568 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:55:01.977329 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c801ecc2-ccd0-4499-8c86-dd08c9839dd0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:01.978842 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c801ecc2-ccd0-4499-8c86-dd08c9839dd0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:01.989604 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c801ecc2-ccd0-4499-8c86-dd08c9839dd0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:01.990229 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c801ecc2-ccd0-4499-8c86-dd08c9839dd0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:01.990993 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c801ecc2-ccd0-4499-8c86-dd08c9839dd0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:01.992042 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c801ecc2-ccd0-4499-8c86-dd08c9839dd0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:02.112265 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c801ecc2-ccd0-4499-8c86-dd08c9839dd0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28671 microversion: 2.20 time: 0.139922 Apr 15 19:55:02.119732 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 213/419] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:55:01 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28671 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:55:02.126786 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-8a167529-d336-4b25-b1f2-3c97234e4467 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:02.130246 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-8a167529-d336-4b25-b1f2-3c97234e4467 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:02.155829 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8a167529-d336-4b25-b1f2-3c97234e4467 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:02.156358 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8a167529-d336-4b25-b1f2-3c97234e4467 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:02.157371 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8a167529-d336-4b25-b1f2-3c97234e4467 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:02.157872 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8a167529-d336-4b25-b1f2-3c97234e4467 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:02.317190 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-8a167529-d336-4b25-b1f2-3c97234e4467 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28208 microversion: 2.1 time: 0.194896 Apr 15 19:55:02.321860 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 214/420] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:02 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28208 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:55:02.339841 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-f7f9859e-5ab7-41cf-afd4-d399df860b51 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Flavor limits 0:0:0 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 15 19:55:02.340233 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-f7f9859e-5ab7-41cf-afd4-d399df860b51 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Image limits 0:0:0 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 15 19:55:02.340772 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-f7f9859e-5ab7-41cf-afd4-d399df860b51 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Flavor pref 0:0:0 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 15 19:55:02.341230 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-f7f9859e-5ab7-41cf-afd4-d399df860b51 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Image pref 0:0:0 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 15 19:55:02.341686 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-f7f9859e-5ab7-41cf-afd4-d399df860b51 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 15 19:55:02.370598 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f7f9859e-5ab7-41cf-afd4-d399df860b51 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:02.371109 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f7f9859e-5ab7-41cf-afd4-d399df860b51 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:02.378751 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f7f9859e-5ab7-41cf-afd4-d399df860b51 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:02.379293 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f7f9859e-5ab7-41cf-afd4-d399df860b51 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:02.407089 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-f7f9859e-5ab7-41cf-afd4-d399df860b51 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Getting quotas for project 53bc040eb9af4c96ac478d1091ca1b60. Resources: {'cores', 'instances', 'ram'} {{(pid=99512) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 15 19:55:02.411771 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-f7f9859e-5ab7-41cf-afd4-d399df860b51 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Getting quotas for user 1cb2653fe9004615a5ecf575c999c2de and project 53bc040eb9af4c96ac478d1091ca1b60. Resources: {'cores', 'instances', 'ram'} {{(pid=99512) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 15 19:55:02.424254 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f7f9859e-5ab7-41cf-afd4-d399df860b51 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Going to run 1 instances... {{(pid=99512) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 15 19:55:02.427073 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f7f9859e-5ab7-41cf-afd4-d399df860b51 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: a5f4046a-6bc2-4099-afa3-c1a2d16c38f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='10d66d6e-f687-4228-93d1-67502c9b42e2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 15 19:55:02.492596 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f7f9859e-5ab7-41cf-afd4-d399df860b51 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.055398 Apr 15 19:55:02.494455 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 207/421] 10.222.0.58 () {60 vars in 1137 bytes} [Thu Apr 15 19:55:01 2021] POST /compute/v2.1/servers => generated 380 bytes in 1058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 15 19:55:02.508772 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-2d99f092-95e3-4559-9b58-5ce9896bb554 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:02.510589 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-2d99f092-95e3-4559-9b58-5ce9896bb554 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: a5f4046a-6bc2-4099-afa3-c1a2d16c38f0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:02.891033 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-2d99f092-95e3-4559-9b58-5ce9896bb554 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb2653fe9004615a5ecf575c999c2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bc040eb9af4c96ac478d1091ca1b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:02.907161 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-2d99f092-95e3-4559-9b58-5ce9896bb554 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0" status: 200 len: 1219 microversion: 2.1 time: 0.401860 Apr 15 19:55:02.907910 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 215/422] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:02 2021] GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0 => generated 1219 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:55:02.990089 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c277809e-04d8-45d0-a295-f88b3eeb5a6b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:02.991138 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c277809e-04d8-45d0-a295-f88b3eeb5a6b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:03.003179 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c277809e-04d8-45d0-a295-f88b3eeb5a6b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:03.004100 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c277809e-04d8-45d0-a295-f88b3eeb5a6b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:03.005394 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c277809e-04d8-45d0-a295-f88b3eeb5a6b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:03.006724 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c277809e-04d8-45d0-a295-f88b3eeb5a6b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:03.127262 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-40a40e66-c708-4b03-b7bb-9092a5a6a82a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:03.129668 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-40a40e66-c708-4b03-b7bb-9092a5a6a82a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:03.158433 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-40a40e66-c708-4b03-b7bb-9092a5a6a82a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:03.158943 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-40a40e66-c708-4b03-b7bb-9092a5a6a82a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:03.159878 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-40a40e66-c708-4b03-b7bb-9092a5a6a82a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:03.160375 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-40a40e66-c708-4b03-b7bb-9092a5a6a82a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:03.328656 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-40a40e66-c708-4b03-b7bb-9092a5a6a82a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28671 microversion: 2.20 time: 0.205422 Apr 15 19:55:03.333581 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 216/423] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:55:03 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28671 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:55:03.344139 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-20c32d56-8e9f-4a64-a563-910d7dd78fc9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:03.355735 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-20c32d56-8e9f-4a64-a563-910d7dd78fc9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:03.371384 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-20c32d56-8e9f-4a64-a563-910d7dd78fc9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:03.372443 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-20c32d56-8e9f-4a64-a563-910d7dd78fc9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:03.381783 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-20c32d56-8e9f-4a64-a563-910d7dd78fc9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:03.381783 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-20c32d56-8e9f-4a64-a563-910d7dd78fc9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:03.606850 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-20c32d56-8e9f-4a64-a563-910d7dd78fc9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28208 microversion: 2.1 time: 0.276000 Apr 15 19:55:03.608296 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 217/424] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:03 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28208 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:55:03.684105 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c277809e-04d8-45d0-a295-f88b3eeb5a6b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:03.698357 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c277809e-04d8-45d0-a295-f88b3eeb5a6b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1568 microversion: 2.1 time: 0.713723 Apr 15 19:55:03.699130 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 208/425] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:02 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1568 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:55:03.926924 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-fcf54b30-1ce3-44f0-bfde-d80d44a11ca2 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:03.928059 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-fcf54b30-1ce3-44f0-bfde-d80d44a11ca2 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: a5f4046a-6bc2-4099-afa3-c1a2d16c38f0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:03.945007 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fcf54b30-1ce3-44f0-bfde-d80d44a11ca2 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:03.945749 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fcf54b30-1ce3-44f0-bfde-d80d44a11ca2 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:03.946893 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fcf54b30-1ce3-44f0-bfde-d80d44a11ca2 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:03.948167 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fcf54b30-1ce3-44f0-bfde-d80d44a11ca2 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:04.181855 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-fcf54b30-1ce3-44f0-bfde-d80d44a11ca2 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb2653fe9004615a5ecf575c999c2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bc040eb9af4c96ac478d1091ca1b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:04.197947 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-fcf54b30-1ce3-44f0-bfde-d80d44a11ca2 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0" status: 200 len: 1215 microversion: 2.1 time: 0.272209 Apr 15 19:55:04.198816 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 218/426] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:03 2021] GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0 => generated 1215 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:55:04.342377 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d6e21683-0f21-470a-bbad-f9f54c61b37a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:04.344804 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d6e21683-0f21-470a-bbad-f9f54c61b37a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:04.363898 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d6e21683-0f21-470a-bbad-f9f54c61b37a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:04.365190 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d6e21683-0f21-470a-bbad-f9f54c61b37a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:04.366310 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d6e21683-0f21-470a-bbad-f9f54c61b37a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:04.367011 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d6e21683-0f21-470a-bbad-f9f54c61b37a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:04.584008 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d6e21683-0f21-470a-bbad-f9f54c61b37a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28671 microversion: 2.20 time: 0.247262 Apr 15 19:55:04.584829 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 209/427] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:55:04 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28671 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:55:04.621234 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-bf2a3ab5-8284-44bf-b5b1-757c76d8e539 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:04.622557 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-bf2a3ab5-8284-44bf-b5b1-757c76d8e539 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:04.639836 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bf2a3ab5-8284-44bf-b5b1-757c76d8e539 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:04.641545 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bf2a3ab5-8284-44bf-b5b1-757c76d8e539 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:04.646157 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bf2a3ab5-8284-44bf-b5b1-757c76d8e539 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:04.647433 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bf2a3ab5-8284-44bf-b5b1-757c76d8e539 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:04.717706 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-48e69cdd-bd2a-4423-aa7d-161b85fa4135 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:04.718854 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-48e69cdd-bd2a-4423-aa7d-161b85fa4135 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:04.732368 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-48e69cdd-bd2a-4423-aa7d-161b85fa4135 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:04.739880 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-48e69cdd-bd2a-4423-aa7d-161b85fa4135 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:04.741021 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-48e69cdd-bd2a-4423-aa7d-161b85fa4135 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:04.741728 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-48e69cdd-bd2a-4423-aa7d-161b85fa4135 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:04.846172 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-bf2a3ab5-8284-44bf-b5b1-757c76d8e539 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28208 microversion: 2.1 time: 0.229719 Apr 15 19:55:04.847109 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 219/428] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:04 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28208 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:55:05.218089 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-99cec7ea-1212-4df7-808f-ea76912707c0 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:05.219662 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-99cec7ea-1212-4df7-808f-ea76912707c0 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: a5f4046a-6bc2-4099-afa3-c1a2d16c38f0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:05.236335 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-99cec7ea-1212-4df7-808f-ea76912707c0 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:05.236852 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-99cec7ea-1212-4df7-808f-ea76912707c0 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:05.237711 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-99cec7ea-1212-4df7-808f-ea76912707c0 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:05.238212 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-99cec7ea-1212-4df7-808f-ea76912707c0 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:05.660478 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-99cec7ea-1212-4df7-808f-ea76912707c0 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb2653fe9004615a5ecf575c999c2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bc040eb9af4c96ac478d1091ca1b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:05.671884 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-99cec7ea-1212-4df7-808f-ea76912707c0 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0" status: 200 len: 1289 microversion: 2.1 time: 0.458271 Apr 15 19:55:05.672932 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 220/429] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:05 2021] GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0 => generated 1289 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:55:05.678702 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-2e3f0ba9-5e0d-4a75-8b7e-df72f3304185 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:05.680015 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-2e3f0ba9-5e0d-4a75-8b7e-df72f3304185 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:05.689370 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2e3f0ba9-5e0d-4a75-8b7e-df72f3304185 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:05.690104 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2e3f0ba9-5e0d-4a75-8b7e-df72f3304185 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:05.691115 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2e3f0ba9-5e0d-4a75-8b7e-df72f3304185 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:05.692190 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2e3f0ba9-5e0d-4a75-8b7e-df72f3304185 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:05.802421 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-2e3f0ba9-5e0d-4a75-8b7e-df72f3304185 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28671 microversion: 2.20 time: 0.127738 Apr 15 19:55:05.803388 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 221/430] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:55:05 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28671 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:55:05.860738 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ee610040-e07b-4632-9922-fe47cdbde322 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:05.861508 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ee610040-e07b-4632-9922-fe47cdbde322 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:05.874252 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ee610040-e07b-4632-9922-fe47cdbde322 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:05.874252 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ee610040-e07b-4632-9922-fe47cdbde322 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:05.874252 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ee610040-e07b-4632-9922-fe47cdbde322 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:05.874595 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ee610040-e07b-4632-9922-fe47cdbde322 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:06.002636 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ee610040-e07b-4632-9922-fe47cdbde322 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28499 microversion: 2.1 time: 0.147709 Apr 15 19:55:06.003894 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 222/431] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:05 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28499 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:55:06.169743 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-48e69cdd-bd2a-4423-aa7d-161b85fa4135 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:06.191818 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-48e69cdd-bd2a-4423-aa7d-161b85fa4135 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1568 microversion: 2.1 time: 1.479128 Apr 15 19:55:06.194049 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 210/432] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:04 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1568 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:55:06.694394 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-38535395-57a0-4006-a30f-da5fb1c32624 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:06.702531 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-38535395-57a0-4006-a30f-da5fb1c32624 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: a5f4046a-6bc2-4099-afa3-c1a2d16c38f0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:06.713747 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-38535395-57a0-4006-a30f-da5fb1c32624 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:06.714432 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-38535395-57a0-4006-a30f-da5fb1c32624 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:06.715440 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-38535395-57a0-4006-a30f-da5fb1c32624 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:06.716057 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-38535395-57a0-4006-a30f-da5fb1c32624 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:06.818086 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c3e9f15c-4bd8-4d9f-93d1-c530b174195f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:06.819912 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c3e9f15c-4bd8-4d9f-93d1-c530b174195f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:06.834148 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c3e9f15c-4bd8-4d9f-93d1-c530b174195f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:06.837294 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c3e9f15c-4bd8-4d9f-93d1-c530b174195f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:06.838355 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c3e9f15c-4bd8-4d9f-93d1-c530b174195f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:06.848166 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c3e9f15c-4bd8-4d9f-93d1-c530b174195f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:07.013072 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c3e9f15c-4bd8-4d9f-93d1-c530b174195f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28671 microversion: 2.20 time: 0.200671 Apr 15 19:55:07.018419 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 211/433] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:55:06 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28671 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:55:07.024764 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-cd6a6d66-1feb-450f-a3eb-6320b4be63c3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:07.026290 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-cd6a6d66-1feb-450f-a3eb-6320b4be63c3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:07.048355 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cd6a6d66-1feb-450f-a3eb-6320b4be63c3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:07.049263 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cd6a6d66-1feb-450f-a3eb-6320b4be63c3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:07.050301 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cd6a6d66-1feb-450f-a3eb-6320b4be63c3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:07.053485 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cd6a6d66-1feb-450f-a3eb-6320b4be63c3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:07.179993 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-38535395-57a0-4006-a30f-da5fb1c32624 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb2653fe9004615a5ecf575c999c2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bc040eb9af4c96ac478d1091ca1b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:07.202353 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-38535395-57a0-4006-a30f-da5fb1c32624 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0" status: 200 len: 1277 microversion: 2.1 time: 0.515159 Apr 15 19:55:07.203208 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 223/434] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:06 2021] GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0 => generated 1277 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:55:07.218517 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-0e3df83b-7341-4f36-b247-1ef42a7b9b79 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:07.219306 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-0e3df83b-7341-4f36-b247-1ef42a7b9b79 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:07.245330 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0e3df83b-7341-4f36-b247-1ef42a7b9b79 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:07.246074 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0e3df83b-7341-4f36-b247-1ef42a7b9b79 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:07.247071 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0e3df83b-7341-4f36-b247-1ef42a7b9b79 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:07.247720 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0e3df83b-7341-4f36-b247-1ef42a7b9b79 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:07.270850 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-cd6a6d66-1feb-450f-a3eb-6320b4be63c3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28665 microversion: 2.1 time: 0.249840 Apr 15 19:55:07.271982 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 212/435] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:07 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28665 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:55:07.739836 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-0e3df83b-7341-4f36-b247-1ef42a7b9b79 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:07.752581 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-0e3df83b-7341-4f36-b247-1ef42a7b9b79 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1568 microversion: 2.1 time: 0.538385 Apr 15 19:55:07.753296 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 224/436] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:07 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1568 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:55:08.028061 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-df7a6cfb-625f-44b2-9737-03ac1c52d53b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:08.030160 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-df7a6cfb-625f-44b2-9737-03ac1c52d53b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:08.063979 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-df7a6cfb-625f-44b2-9737-03ac1c52d53b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:08.064863 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-df7a6cfb-625f-44b2-9737-03ac1c52d53b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:08.065992 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-df7a6cfb-625f-44b2-9737-03ac1c52d53b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:08.066611 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-df7a6cfb-625f-44b2-9737-03ac1c52d53b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:08.222950 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-01b42fe4-b49f-4e1b-9907-d2a72fecf5af tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:08.225103 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-01b42fe4-b49f-4e1b-9907-d2a72fecf5af tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: a5f4046a-6bc2-4099-afa3-c1a2d16c38f0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:08.243722 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-01b42fe4-b49f-4e1b-9907-d2a72fecf5af tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:08.244577 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-01b42fe4-b49f-4e1b-9907-d2a72fecf5af tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:08.244693 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-df7a6cfb-625f-44b2-9737-03ac1c52d53b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28671 microversion: 2.20 time: 0.222435 Apr 15 19:55:08.245634 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 213/437] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:55:08 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28671 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:55:08.249073 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-01b42fe4-b49f-4e1b-9907-d2a72fecf5af tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:08.253196 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-01b42fe4-b49f-4e1b-9907-d2a72fecf5af tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:08.287035 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-351ca353-31f1-4fc0-adfe-21bc505488a5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:08.287721 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-351ca353-31f1-4fc0-adfe-21bc505488a5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:08.323120 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-351ca353-31f1-4fc0-adfe-21bc505488a5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:08.323792 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-351ca353-31f1-4fc0-adfe-21bc505488a5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:08.324720 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-351ca353-31f1-4fc0-adfe-21bc505488a5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:08.325227 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-351ca353-31f1-4fc0-adfe-21bc505488a5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:08.565239 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-351ca353-31f1-4fc0-adfe-21bc505488a5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28667 microversion: 2.1 time: 0.283822 Apr 15 19:55:08.565959 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 214/438] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:08 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28667 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 15 19:55:08.771995 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-544bab55-375e-4219-b36b-24c37a2f88a2 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:08.772823 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-544bab55-375e-4219-b36b-24c37a2f88a2 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:08.794182 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-544bab55-375e-4219-b36b-24c37a2f88a2 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:08.794846 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-544bab55-375e-4219-b36b-24c37a2f88a2 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:08.795948 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-544bab55-375e-4219-b36b-24c37a2f88a2 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:08.796586 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-544bab55-375e-4219-b36b-24c37a2f88a2 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:09.883875 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-01b42fe4-b49f-4e1b-9907-d2a72fecf5af tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb2653fe9004615a5ecf575c999c2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bc040eb9af4c96ac478d1091ca1b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:09.897028 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-01b42fe4-b49f-4e1b-9907-d2a72fecf5af tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0" status: 200 len: 1319 microversion: 2.1 time: 1.677928 Apr 15 19:55:09.899959 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 225/439] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:08 2021] GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0 => generated 1319 bytes in 1682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:55:09.912221 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-544bab55-375e-4219-b36b-24c37a2f88a2 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:09.913520 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-508f9c7e-b1d5-4d67-a4c2-cbace5052e24 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:09.916365 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-508f9c7e-b1d5-4d67-a4c2-cbace5052e24 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:09.926818 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-544bab55-375e-4219-b36b-24c37a2f88a2 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1568 microversion: 2.1 time: 1.159631 Apr 15 19:55:09.930978 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 215/440] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:08 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1568 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:55:09.939667 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-508f9c7e-b1d5-4d67-a4c2-cbace5052e24 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:09.939933 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-508f9c7e-b1d5-4d67-a4c2-cbace5052e24 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:09.946738 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-508f9c7e-b1d5-4d67-a4c2-cbace5052e24 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:09.946942 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-24cb05c4-9a64-4cf9-a497-87f5ab8b134c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:09.947832 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-508f9c7e-b1d5-4d67-a4c2-cbace5052e24 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:09.959309 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-24cb05c4-9a64-4cf9-a497-87f5ab8b134c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:09.971560 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-24cb05c4-9a64-4cf9-a497-87f5ab8b134c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:09.973948 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-24cb05c4-9a64-4cf9-a497-87f5ab8b134c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:09.975302 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-24cb05c4-9a64-4cf9-a497-87f5ab8b134c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:09.979137 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-24cb05c4-9a64-4cf9-a497-87f5ab8b134c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:10.159893 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-24cb05c4-9a64-4cf9-a497-87f5ab8b134c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28667 microversion: 2.1 time: 0.217764 Apr 15 19:55:10.160731 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 216/441] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:09 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28667 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:55:10.192103 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-508f9c7e-b1d5-4d67-a4c2-cbace5052e24 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 28833 microversion: 2.20 time: 0.287800 Apr 15 19:55:10.196510 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 226/442] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:55:09 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 28833 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:55:10.924095 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b971507b-3239-436f-8ca0-8dc350325b22 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:10.925009 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b971507b-3239-436f-8ca0-8dc350325b22 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: a5f4046a-6bc2-4099-afa3-c1a2d16c38f0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:10.953202 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-bf9d334c-a741-4384-84fd-47a655001ff7 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:10.962976 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-bf9d334c-a741-4384-84fd-47a655001ff7 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:10.964760 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b971507b-3239-436f-8ca0-8dc350325b22 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:10.965939 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b971507b-3239-436f-8ca0-8dc350325b22 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:10.967082 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b971507b-3239-436f-8ca0-8dc350325b22 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:10.967836 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b971507b-3239-436f-8ca0-8dc350325b22 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:10.972823 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bf9d334c-a741-4384-84fd-47a655001ff7 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:10.973350 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bf9d334c-a741-4384-84fd-47a655001ff7 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:10.977413 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bf9d334c-a741-4384-84fd-47a655001ff7 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:10.978279 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bf9d334c-a741-4384-84fd-47a655001ff7 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:12.109998 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-bf9d334c-a741-4384-84fd-47a655001ff7 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:12.129804 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-bf9d334c-a741-4384-84fd-47a655001ff7 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1568 microversion: 2.1 time: 1.182769 Apr 15 19:55:12.139578 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 227/443] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:10 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1568 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:55:12.147132 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b971507b-3239-436f-8ca0-8dc350325b22 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb2653fe9004615a5ecf575c999c2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bc040eb9af4c96ac478d1091ca1b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:12.163698 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d37641b4-58a1-43e2-afec-878eaff3b23f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:12.163698 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d37641b4-58a1-43e2-afec-878eaff3b23f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:12.171667 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b971507b-3239-436f-8ca0-8dc350325b22 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0" status: 200 len: 1319 microversion: 2.1 time: 1.254859 Apr 15 19:55:12.172665 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 217/444] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:10 2021] GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0 => generated 1319 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:55:12.178244 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9f11e151-43b1-4429-8ba2-6a0862faefe8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:12.179521 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9f11e151-43b1-4429-8ba2-6a0862faefe8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:12.188194 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9f11e151-43b1-4429-8ba2-6a0862faefe8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:12.188953 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9f11e151-43b1-4429-8ba2-6a0862faefe8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:12.190006 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9f11e151-43b1-4429-8ba2-6a0862faefe8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:12.190678 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9f11e151-43b1-4429-8ba2-6a0862faefe8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:12.191389 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d37641b4-58a1-43e2-afec-878eaff3b23f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:12.191916 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d37641b4-58a1-43e2-afec-878eaff3b23f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:12.192783 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d37641b4-58a1-43e2-afec-878eaff3b23f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:12.193279 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d37641b4-58a1-43e2-afec-878eaff3b23f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:12.353778 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d37641b4-58a1-43e2-afec-878eaff3b23f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28667 microversion: 2.1 time: 0.214530 Apr 15 19:55:12.354492 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 228/445] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:12 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28667 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:55:12.368541 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9f11e151-43b1-4429-8ba2-6a0862faefe8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 32045 microversion: 2.20 time: 0.194254 Apr 15 19:55:12.376116 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 218/446] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:55:12 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 32045 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:55:12.705899 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-340e84fa-cbe9-485f-8e41-cf8ceb81f87e req-d14ed963-7637-4e0c-a6fe-fc77ba67cc41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5f4046a-6bc2-4099-afa3-c1a2d16c38f0", "tag": "b4edfcb4-a2bd-4e43-83b4-3f5d12f99260"}]} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:12.710347 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:55:12.710347 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:55:12.726645 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-340e84fa-cbe9-485f-8e41-cf8ceb81f87e req-d14ed963-7637-4e0c-a6fe-fc77ba67cc41 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:12.727741 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-340e84fa-cbe9-485f-8e41-cf8ceb81f87e req-d14ed963-7637-4e0c-a6fe-fc77ba67cc41 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:12.766597 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-340e84fa-cbe9-485f-8e41-cf8ceb81f87e req-d14ed963-7637-4e0c-a6fe-fc77ba67cc41 service nova] Creating event network-changed:b4edfcb4-a2bd-4e43-83b4-3f5d12f99260 for instance a5f4046a-6bc2-4099-afa3-c1a2d16c38f0 on hv-cinder-78638 Apr 15 19:55:12.786809 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-340e84fa-cbe9-485f-8e41-cf8ceb81f87e req-d14ed963-7637-4e0c-a6fe-fc77ba67cc41 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090318 Apr 15 19:55:12.801336 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 229/447] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:55:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:55:13.151865 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-0957867f-316a-442b-9a19-9726503687e6 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:13.153187 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-0957867f-316a-442b-9a19-9726503687e6 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:13.162805 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0957867f-316a-442b-9a19-9726503687e6 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:13.163651 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0957867f-316a-442b-9a19-9726503687e6 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:13.164705 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0957867f-316a-442b-9a19-9726503687e6 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:13.165392 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0957867f-316a-442b-9a19-9726503687e6 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:13.191248 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-beffb352-bab5-4842-a2a3-abfe3ff26f9e tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:13.192230 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-beffb352-bab5-4842-a2a3-abfe3ff26f9e tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: a5f4046a-6bc2-4099-afa3-c1a2d16c38f0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:13.214804 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-beffb352-bab5-4842-a2a3-abfe3ff26f9e tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:13.215520 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-beffb352-bab5-4842-a2a3-abfe3ff26f9e tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:13.217263 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-beffb352-bab5-4842-a2a3-abfe3ff26f9e tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:13.219503 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-beffb352-bab5-4842-a2a3-abfe3ff26f9e tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:14.951618 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-beffb352-bab5-4842-a2a3-abfe3ff26f9e tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb2653fe9004615a5ecf575c999c2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bc040eb9af4c96ac478d1091ca1b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:14.960873 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-beffb352-bab5-4842-a2a3-abfe3ff26f9e tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0" status: 200 len: 1319 microversion: 2.1 time: 1.774311 Apr 15 19:55:14.970839 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 230/448] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:13 2021] GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0 => generated 1319 bytes in 1777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:55:14.970839 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a0cb16f6-b63d-4b50-896c-2ca94c2d837d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:14.970839 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a0cb16f6-b63d-4b50-896c-2ca94c2d837d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:14.976043 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a0cb16f6-b63d-4b50-896c-2ca94c2d837d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:14.976553 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a0cb16f6-b63d-4b50-896c-2ca94c2d837d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:14.977411 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a0cb16f6-b63d-4b50-896c-2ca94c2d837d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:14.977904 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a0cb16f6-b63d-4b50-896c-2ca94c2d837d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:15.046936 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-0957867f-316a-442b-9a19-9726503687e6 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:15.066871 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-0957867f-316a-442b-9a19-9726503687e6 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1568 microversion: 2.1 time: 1.919918 Apr 15 19:55:15.068719 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 219/449] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:13 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1568 bytes in 1923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:55:15.073695 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-3a3eeac7-9f1d-4de9-b76a-387c8353163a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:15.074926 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-3a3eeac7-9f1d-4de9-b76a-387c8353163a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:15.083484 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3a3eeac7-9f1d-4de9-b76a-387c8353163a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:15.084683 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3a3eeac7-9f1d-4de9-b76a-387c8353163a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:15.088247 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3a3eeac7-9f1d-4de9-b76a-387c8353163a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:15.088938 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3a3eeac7-9f1d-4de9-b76a-387c8353163a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:15.739055 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a0cb16f6-b63d-4b50-896c-2ca94c2d837d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28667 microversion: 2.1 time: 0.775717 Apr 15 19:55:15.740017 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 231/450] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:14 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28667 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:55:15.753854 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-3a3eeac7-9f1d-4de9-b76a-387c8353163a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 35173 microversion: 2.20 time: 0.683748 Apr 15 19:55:15.755033 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 220/451] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:55:15 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 35173 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:55:15.978984 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-2336b67b-d795-4a38-8b37-0370bc4e66d5 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:15.980460 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-2336b67b-d795-4a38-8b37-0370bc4e66d5 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: a5f4046a-6bc2-4099-afa3-c1a2d16c38f0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:15.990333 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2336b67b-d795-4a38-8b37-0370bc4e66d5 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:15.991198 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2336b67b-d795-4a38-8b37-0370bc4e66d5 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:15.992329 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2336b67b-d795-4a38-8b37-0370bc4e66d5 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:15.993029 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2336b67b-d795-4a38-8b37-0370bc4e66d5 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:16.089617 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-62b10cbf-f357-49a8-b311-b9649fbeb567 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:16.090740 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-62b10cbf-f357-49a8-b311-b9649fbeb567 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:16.100566 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-62b10cbf-f357-49a8-b311-b9649fbeb567 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:16.101538 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-62b10cbf-f357-49a8-b311-b9649fbeb567 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:16.103350 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-62b10cbf-f357-49a8-b311-b9649fbeb567 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:16.104347 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-62b10cbf-f357-49a8-b311-b9649fbeb567 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:16.557154 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-2336b67b-d795-4a38-8b37-0370bc4e66d5 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb2653fe9004615a5ecf575c999c2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bc040eb9af4c96ac478d1091ca1b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:16.589497 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-2336b67b-d795-4a38-8b37-0370bc4e66d5 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0" status: 200 len: 1319 microversion: 2.1 time: 0.606971 Apr 15 19:55:16.590655 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 232/452] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:15 2021] GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0 => generated 1319 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:55:16.630940 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-62b10cbf-f357-49a8-b311-b9649fbeb567 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:16.652537 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-62b10cbf-f357-49a8-b311-b9649fbeb567 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1548 microversion: 2.1 time: 0.568735 Apr 15 19:55:16.653505 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 221/453] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:16 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1548 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:55:16.674849 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-28381b32-1649-4554-a08f-af5c64c38f3e tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:16.676222 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-28381b32-1649-4554-a08f-af5c64c38f3e tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:16.685885 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-28381b32-1649-4554-a08f-af5c64c38f3e tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:16.686704 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-28381b32-1649-4554-a08f-af5c64c38f3e tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:16.689360 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-28381b32-1649-4554-a08f-af5c64c38f3e tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:16.696120 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-28381b32-1649-4554-a08f-af5c64c38f3e tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:16.754332 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-0fda3537-fa1a-46f7-941b-c7f1da79ac66 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:16.756101 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-0fda3537-fa1a-46f7-941b-c7f1da79ac66 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:16.769036 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0fda3537-fa1a-46f7-941b-c7f1da79ac66 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:16.769888 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0fda3537-fa1a-46f7-941b-c7f1da79ac66 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:16.770957 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0fda3537-fa1a-46f7-941b-c7f1da79ac66 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:16.771861 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0fda3537-fa1a-46f7-941b-c7f1da79ac66 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:16.948249 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-0fda3537-fa1a-46f7-941b-c7f1da79ac66 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28667 microversion: 2.1 time: 0.198013 Apr 15 19:55:16.952471 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 222/454] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:16 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28667 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:55:16.955393 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6f511fb6-ba9a-4a4e-bb12-7b1ae5679e91 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:16.956564 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6f511fb6-ba9a-4a4e-bb12-7b1ae5679e91 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:16.972010 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6f511fb6-ba9a-4a4e-bb12-7b1ae5679e91 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:16.972525 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6f511fb6-ba9a-4a4e-bb12-7b1ae5679e91 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:16.973397 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6f511fb6-ba9a-4a4e-bb12-7b1ae5679e91 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:16.973902 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6f511fb6-ba9a-4a4e-bb12-7b1ae5679e91 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:17.012710 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-28381b32-1649-4554-a08f-af5c64c38f3e tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] HTTP exception thrown: Cannot 'detach_volume' instance 4f202f3f-01c9-41c6-842e-ee96f6b40094 while it is in vm_state rescued Apr 15 19:55:17.013417 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-28381b32-1649-4554-a08f-af5c64c38f3e tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Returning 409 to user: Cannot 'detach_volume' instance 4f202f3f-01c9-41c6-842e-ee96f6b40094 while it is in vm_state rescued {{(pid=99511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 19:55:17.014303 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-28381b32-1649-4554-a08f-af5c64c38f3e tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094/os-volume_attachments/12ba5081-3a8a-42e1-a0ac-8cca49ee8062" status: 409 len: 152 microversion: 2.1 time: 0.346335 Apr 15 19:55:17.020960 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 233/455] 10.222.0.58 () {58 vars in 1406 bytes} [Thu Apr 15 19:55:16 2021] DELETE /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094/os-volume_attachments/12ba5081-3a8a-42e1-a0ac-8cca49ee8062 => generated 152 bytes in 355 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 15 19:55:17.034651 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-539d58cb-2e7e-4d81-aabf-de4562a43011 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:17.037146 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-539d58cb-2e7e-4d81-aabf-de4562a43011 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:17.062523 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-539d58cb-2e7e-4d81-aabf-de4562a43011 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:17.063424 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-539d58cb-2e7e-4d81-aabf-de4562a43011 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:17.064495 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-539d58cb-2e7e-4d81-aabf-de4562a43011 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:17.067807 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-539d58cb-2e7e-4d81-aabf-de4562a43011 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:17.260061 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-539d58cb-2e7e-4d81-aabf-de4562a43011 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "POST /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094/action" status: 202 len: 0 microversion: 2.1 time: 0.234331 Apr 15 19:55:17.261427 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 234/456] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:17 2021] POST /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:55:17.272284 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9a5a5152-76b1-4478-9054-2e76be6d51ce tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:17.274441 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9a5a5152-76b1-4478-9054-2e76be6d51ce tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:17.284068 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9a5a5152-76b1-4478-9054-2e76be6d51ce tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:17.285795 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9a5a5152-76b1-4478-9054-2e76be6d51ce tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:17.286787 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9a5a5152-76b1-4478-9054-2e76be6d51ce tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:17.287441 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9a5a5152-76b1-4478-9054-2e76be6d51ce tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:17.348400 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6f511fb6-ba9a-4a4e-bb12-7b1ae5679e91 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 36835 microversion: 2.20 time: 0.397217 Apr 15 19:55:17.349115 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 223/457] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:55:16 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 36835 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:55:17.609728 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e4433f2f-85c7-435a-9970-bee29b6f135d tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:17.611726 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e4433f2f-85c7-435a-9970-bee29b6f135d tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: a5f4046a-6bc2-4099-afa3-c1a2d16c38f0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:17.638483 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e4433f2f-85c7-435a-9970-bee29b6f135d tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:17.639866 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e4433f2f-85c7-435a-9970-bee29b6f135d tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:17.646972 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e4433f2f-85c7-435a-9970-bee29b6f135d tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:17.648354 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e4433f2f-85c7-435a-9970-bee29b6f135d tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:17.923838 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9a5a5152-76b1-4478-9054-2e76be6d51ce tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:17.941947 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9a5a5152-76b1-4478-9054-2e76be6d51ce tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1556 microversion: 2.1 time: 0.675540 Apr 15 19:55:17.953035 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 235/458] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:17 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1556 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:55:17.965646 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f84343df-396e-41ff-9481-8cf1eaaadd95 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:17.967060 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f84343df-396e-41ff-9481-8cf1eaaadd95 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:17.984902 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f84343df-396e-41ff-9481-8cf1eaaadd95 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:17.985673 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f84343df-396e-41ff-9481-8cf1eaaadd95 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:17.986688 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f84343df-396e-41ff-9481-8cf1eaaadd95 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:17.988306 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f84343df-396e-41ff-9481-8cf1eaaadd95 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:18.138556 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f84343df-396e-41ff-9481-8cf1eaaadd95 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28667 microversion: 2.1 time: 0.176458 Apr 15 19:55:18.139142 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 236/459] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:17 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28667 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:55:18.362787 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-cd7a9aef-c432-4bdf-950f-2816a70976ab tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:18.363968 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-cd7a9aef-c432-4bdf-950f-2816a70976ab tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:18.383553 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cd7a9aef-c432-4bdf-950f-2816a70976ab tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:18.384059 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cd7a9aef-c432-4bdf-950f-2816a70976ab tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:18.384917 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cd7a9aef-c432-4bdf-950f-2816a70976ab tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:18.385405 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cd7a9aef-c432-4bdf-950f-2816a70976ab tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:18.526864 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-e4433f2f-85c7-435a-9970-bee29b6f135d tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb2653fe9004615a5ecf575c999c2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bc040eb9af4c96ac478d1091ca1b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:18.542899 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e4433f2f-85c7-435a-9970-bee29b6f135d tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0" status: 200 len: 1319 microversion: 2.1 time: 0.938560 Apr 15 19:55:18.543580 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 224/460] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:17 2021] GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0 => generated 1319 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:55:18.618908 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-cd7a9aef-c432-4bdf-950f-2816a70976ab tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 38225 microversion: 2.20 time: 0.260475 Apr 15 19:55:18.620674 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 237/461] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:55:18 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 38225 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:55:18.963154 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-36d23df3-1a1a-425d-894b-4822b86359b7 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:18.963878 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-36d23df3-1a1a-425d-894b-4822b86359b7 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:18.974962 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-36d23df3-1a1a-425d-894b-4822b86359b7 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:18.977289 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-36d23df3-1a1a-425d-894b-4822b86359b7 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:18.978175 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-36d23df3-1a1a-425d-894b-4822b86359b7 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:18.978678 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-36d23df3-1a1a-425d-894b-4822b86359b7 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:19.153534 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-5d224c51-d1ee-4bde-b773-7bd550d50502 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:19.155646 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-5d224c51-d1ee-4bde-b773-7bd550d50502 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:19.168895 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5d224c51-d1ee-4bde-b773-7bd550d50502 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:19.169773 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5d224c51-d1ee-4bde-b773-7bd550d50502 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:19.172231 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5d224c51-d1ee-4bde-b773-7bd550d50502 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:19.173362 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5d224c51-d1ee-4bde-b773-7bd550d50502 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:19.331817 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-5d224c51-d1ee-4bde-b773-7bd550d50502 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28667 microversion: 2.1 time: 0.184522 Apr 15 19:55:19.337259 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 238/462] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:19 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28667 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:55:19.548351 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-36d23df3-1a1a-425d-894b-4822b86359b7 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:19.561996 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-36d23df3-1a1a-425d-894b-4822b86359b7 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1556 microversion: 2.1 time: 0.605293 Apr 15 19:55:19.563324 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 225/463] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:18 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1556 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:55:19.568106 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-97a75c3c-3c4c-405f-849a-59fd72801d91 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:19.569393 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-97a75c3c-3c4c-405f-849a-59fd72801d91 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: a5f4046a-6bc2-4099-afa3-c1a2d16c38f0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:19.599978 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-97a75c3c-3c4c-405f-849a-59fd72801d91 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:19.600755 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-97a75c3c-3c4c-405f-849a-59fd72801d91 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:19.612496 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-97a75c3c-3c4c-405f-849a-59fd72801d91 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:19.613020 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-97a75c3c-3c4c-405f-849a-59fd72801d91 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:19.634485 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f8f3e42e-0a52-4be4-9e6f-b5c799be228a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:19.635530 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f8f3e42e-0a52-4be4-9e6f-b5c799be228a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:19.656273 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f8f3e42e-0a52-4be4-9e6f-b5c799be228a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:19.661483 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f8f3e42e-0a52-4be4-9e6f-b5c799be228a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:19.662413 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f8f3e42e-0a52-4be4-9e6f-b5c799be228a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:19.669450 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f8f3e42e-0a52-4be4-9e6f-b5c799be228a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:19.842349 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f8f3e42e-0a52-4be4-9e6f-b5c799be228a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 38225 microversion: 2.20 time: 0.212337 Apr 15 19:55:19.843580 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 226/464] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:55:19 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 38225 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:55:20.353082 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7fc0f5c3-ad1f-4979-a35e-6839e809f4de tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:20.354235 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7fc0f5c3-ad1f-4979-a35e-6839e809f4de tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:20.386595 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7fc0f5c3-ad1f-4979-a35e-6839e809f4de tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:20.388906 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7fc0f5c3-ad1f-4979-a35e-6839e809f4de tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:20.392754 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7fc0f5c3-ad1f-4979-a35e-6839e809f4de tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:20.393846 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7fc0f5c3-ad1f-4979-a35e-6839e809f4de tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:20.483686 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-97a75c3c-3c4c-405f-849a-59fd72801d91 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb2653fe9004615a5ecf575c999c2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bc040eb9af4c96ac478d1091ca1b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:20.500388 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-97a75c3c-3c4c-405f-849a-59fd72801d91 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0" status: 200 len: 1319 microversion: 2.1 time: 0.942389 Apr 15 19:55:20.516503 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 239/465] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:19 2021] GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0 => generated 1319 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:55:20.553506 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7fc0f5c3-ad1f-4979-a35e-6839e809f4de tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28667 microversion: 2.1 time: 0.207370 Apr 15 19:55:20.554998 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 227/466] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:20 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28667 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 15 19:55:20.581468 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-3e31163e-19fa-4ea4-b679-c53386d32a62 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:20.582140 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-3e31163e-19fa-4ea4-b679-c53386d32a62 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:20.602809 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3e31163e-19fa-4ea4-b679-c53386d32a62 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:20.603332 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3e31163e-19fa-4ea4-b679-c53386d32a62 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:20.604196 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3e31163e-19fa-4ea4-b679-c53386d32a62 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:20.604689 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3e31163e-19fa-4ea4-b679-c53386d32a62 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:20.857595 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7c0cb2da-14e8-4ac1-9cb1-274f46464a90 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:20.858743 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7c0cb2da-14e8-4ac1-9cb1-274f46464a90 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:20.889564 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7c0cb2da-14e8-4ac1-9cb1-274f46464a90 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:20.890867 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7c0cb2da-14e8-4ac1-9cb1-274f46464a90 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:20.892378 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7c0cb2da-14e8-4ac1-9cb1-274f46464a90 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:20.893079 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7c0cb2da-14e8-4ac1-9cb1-274f46464a90 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:21.117217 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7c0cb2da-14e8-4ac1-9cb1-274f46464a90 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 38225 microversion: 2.20 time: 0.265001 Apr 15 19:55:21.118431 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 228/467] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:55:20 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 38225 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:55:21.235338 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3e31163e-19fa-4ea4-b679-c53386d32a62 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:21.251004 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-3e31163e-19fa-4ea4-b679-c53386d32a62 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1556 microversion: 2.1 time: 0.673454 Apr 15 19:55:21.254157 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 240/468] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:20 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1556 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:55:21.534889 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-bed788c1-cc6c-407e-b560-2db163dc1194 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:21.535698 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-bed788c1-cc6c-407e-b560-2db163dc1194 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: a5f4046a-6bc2-4099-afa3-c1a2d16c38f0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:21.556898 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bed788c1-cc6c-407e-b560-2db163dc1194 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:21.557405 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bed788c1-cc6c-407e-b560-2db163dc1194 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:21.558257 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bed788c1-cc6c-407e-b560-2db163dc1194 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:21.558749 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bed788c1-cc6c-407e-b560-2db163dc1194 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:21.566334 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-02ca1ac1-c1fd-44e0-babe-53fe77005911 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:21.567809 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-02ca1ac1-c1fd-44e0-babe-53fe77005911 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:21.582800 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-02ca1ac1-c1fd-44e0-babe-53fe77005911 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:21.583622 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-02ca1ac1-c1fd-44e0-babe-53fe77005911 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:21.585441 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-02ca1ac1-c1fd-44e0-babe-53fe77005911 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:21.589276 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-02ca1ac1-c1fd-44e0-babe-53fe77005911 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:21.797425 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-02ca1ac1-c1fd-44e0-babe-53fe77005911 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28667 microversion: 2.1 time: 0.235008 Apr 15 19:55:21.798133 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 241/469] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:21 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28667 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:55:22.136629 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ee6628c4-260a-4e87-bd4c-a517153104fd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:22.139504 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ee6628c4-260a-4e87-bd4c-a517153104fd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:22.159816 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ee6628c4-260a-4e87-bd4c-a517153104fd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:22.161682 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ee6628c4-260a-4e87-bd4c-a517153104fd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:22.163194 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ee6628c4-260a-4e87-bd4c-a517153104fd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:22.164038 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ee6628c4-260a-4e87-bd4c-a517153104fd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:22.398248 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ee6628c4-260a-4e87-bd4c-a517153104fd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 38225 microversion: 2.20 time: 0.270753 Apr 15 19:55:22.400273 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 242/470] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:55:22 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 38225 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:55:22.413192 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-0b92c679-a496-4495-bd35-8a59dae2ae9a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:22.416194 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-0b92c679-a496-4495-bd35-8a59dae2ae9a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:22.432099 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0b92c679-a496-4495-bd35-8a59dae2ae9a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:22.432535 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0b92c679-a496-4495-bd35-8a59dae2ae9a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:22.433399 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0b92c679-a496-4495-bd35-8a59dae2ae9a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:22.433897 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0b92c679-a496-4495-bd35-8a59dae2ae9a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:22.693227 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-bed788c1-cc6c-407e-b560-2db163dc1194 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb2653fe9004615a5ecf575c999c2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bc040eb9af4c96ac478d1091ca1b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:22.704463 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-bed788c1-cc6c-407e-b560-2db163dc1194 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0" status: 200 len: 1319 microversion: 2.1 time: 1.174186 Apr 15 19:55:22.713663 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 229/471] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:21 2021] GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0 => generated 1319 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:55:22.810425 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a272ef85-0e42-4b2b-9cdd-1cf559ec12eb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:22.811803 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a272ef85-0e42-4b2b-9cdd-1cf559ec12eb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:22.837239 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a272ef85-0e42-4b2b-9cdd-1cf559ec12eb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:22.838158 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a272ef85-0e42-4b2b-9cdd-1cf559ec12eb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:22.839230 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a272ef85-0e42-4b2b-9cdd-1cf559ec12eb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:22.840093 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a272ef85-0e42-4b2b-9cdd-1cf559ec12eb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:22.967810 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a272ef85-0e42-4b2b-9cdd-1cf559ec12eb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28667 microversion: 2.1 time: 0.161186 Apr 15 19:55:22.968539 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 230/472] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:22 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28667 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 15 19:55:23.170420 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-0b92c679-a496-4495-bd35-8a59dae2ae9a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:23.184511 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-0b92c679-a496-4495-bd35-8a59dae2ae9a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1556 microversion: 2.1 time: 0.782660 Apr 15 19:55:23.187240 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 243/473] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:22 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1556 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:55:23.419331 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-2f75f608-1419-4cad-acc4-fd0b927e1e98 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:23.424393 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-2f75f608-1419-4cad-acc4-fd0b927e1e98 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:23.460387 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2f75f608-1419-4cad-acc4-fd0b927e1e98 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:23.460909 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2f75f608-1419-4cad-acc4-fd0b927e1e98 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:23.461778 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2f75f608-1419-4cad-acc4-fd0b927e1e98 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:23.462278 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2f75f608-1419-4cad-acc4-fd0b927e1e98 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:23.726113 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-918a9d04-03fc-40e5-a5e6-d0b706d2be53 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:23.726969 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-918a9d04-03fc-40e5-a5e6-d0b706d2be53 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: a5f4046a-6bc2-4099-afa3-c1a2d16c38f0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:23.752976 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-918a9d04-03fc-40e5-a5e6-d0b706d2be53 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:23.755992 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-918a9d04-03fc-40e5-a5e6-d0b706d2be53 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:23.757059 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-918a9d04-03fc-40e5-a5e6-d0b706d2be53 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:23.760712 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-918a9d04-03fc-40e5-a5e6-d0b706d2be53 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:23.898513 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-2f75f608-1419-4cad-acc4-fd0b927e1e98 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 200 len: 38366 microversion: 2.20 time: 0.490908 Apr 15 19:55:23.899198 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 231/474] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:55:23 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 38366 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:55:23.910204 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-4883dd8a-6bc4-4b66-9459-973747520d95 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:23.911089 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-4883dd8a-6bc4-4b66-9459-973747520d95 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:23.923554 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4883dd8a-6bc4-4b66-9459-973747520d95 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:23.928165 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4883dd8a-6bc4-4b66-9459-973747520d95 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:23.931753 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4883dd8a-6bc4-4b66-9459-973747520d95 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:23.932496 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4883dd8a-6bc4-4b66-9459-973747520d95 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:24.034069 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-4883dd8a-6bc4-4b66-9459-973747520d95 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/ips" status: 200 len: 153 microversion: 2.20 time: 0.127373 Apr 15 19:55:24.035958 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 232/475] 10.222.0.58 () {60 vars in 1279 bytes} [Thu Apr 15 19:55:23 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/ips => generated 153 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 15 19:55:24.041874 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b98db43d-0b04-494d-ae28-ba9fc871c1f7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:24.043242 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b98db43d-0b04-494d-ae28-ba9fc871c1f7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:24.053872 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b98db43d-0b04-494d-ae28-ba9fc871c1f7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:24.054537 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b98db43d-0b04-494d-ae28-ba9fc871c1f7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:24.055442 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b98db43d-0b04-494d-ae28-ba9fc871c1f7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:24.055949 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b98db43d-0b04-494d-ae28-ba9fc871c1f7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:24.189839 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b98db43d-0b04-494d-ae28-ba9fc871c1f7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28667 microversion: 2.1 time: 0.152280 Apr 15 19:55:24.190725 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 233/476] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:24 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28667 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:55:24.205660 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-70368ade-1997-4969-813e-47b8b09e4351 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:24.206449 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-70368ade-1997-4969-813e-47b8b09e4351 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:24.241306 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-70368ade-1997-4969-813e-47b8b09e4351 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:24.241827 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-70368ade-1997-4969-813e-47b8b09e4351 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:24.242697 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-70368ade-1997-4969-813e-47b8b09e4351 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:24.245806 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-70368ade-1997-4969-813e-47b8b09e4351 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:24.749679 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-918a9d04-03fc-40e5-a5e6-d0b706d2be53 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb2653fe9004615a5ecf575c999c2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bc040eb9af4c96ac478d1091ca1b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:24.766391 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-918a9d04-03fc-40e5-a5e6-d0b706d2be53 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0" status: 200 len: 1319 microversion: 2.1 time: 1.044332 Apr 15 19:55:24.788315 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 244/477] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:23 2021] GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0 => generated 1319 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:55:24.926532 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-70368ade-1997-4969-813e-47b8b09e4351 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:24.940372 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-70368ade-1997-4969-813e-47b8b09e4351 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1562 microversion: 2.1 time: 0.739138 Apr 15 19:55:24.941248 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 234/478] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:24 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1562 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:55:25.179124 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-555c7537-55cc-434b-b76a-2589a13d19e0 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:25.181723 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-555c7537-55cc-434b-b76a-2589a13d19e0 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:25.202168 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e8cbde82-87c2-48c3-92e2-9c50d8c69cf4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:25.203383 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e8cbde82-87c2-48c3-92e2-9c50d8c69cf4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:25.212127 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e8cbde82-87c2-48c3-92e2-9c50d8c69cf4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:25.212932 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e8cbde82-87c2-48c3-92e2-9c50d8c69cf4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:25.214142 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e8cbde82-87c2-48c3-92e2-9c50d8c69cf4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:25.214841 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e8cbde82-87c2-48c3-92e2-9c50d8c69cf4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:25.215520 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-555c7537-55cc-434b-b76a-2589a13d19e0 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:25.216033 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-555c7537-55cc-434b-b76a-2589a13d19e0 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:25.216965 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-555c7537-55cc-434b-b76a-2589a13d19e0 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:25.217461 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-555c7537-55cc-434b-b76a-2589a13d19e0 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:25.350370 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e8cbde82-87c2-48c3-92e2-9c50d8c69cf4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28667 microversion: 2.1 time: 0.152788 Apr 15 19:55:25.356002 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 235/479] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:25 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28667 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 15 19:55:25.496535 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.objects.instance [None req-555c7537-55cc-434b-b76a-2589a13d19e0 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lazy-loading 'services' on Instance uuid 4f202f3f-01c9-41c6-842e-ee96f6b40094 {{(pid=99511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 15 19:55:25.809361 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-4e064835-4f2b-4f5b-8828-fe106ac3918e tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:25.810745 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-4e064835-4f2b-4f5b-8828-fe106ac3918e tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: a5f4046a-6bc2-4099-afa3-c1a2d16c38f0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:25.836382 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4e064835-4f2b-4f5b-8828-fe106ac3918e tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:25.836898 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4e064835-4f2b-4f5b-8828-fe106ac3918e tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:25.837756 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4e064835-4f2b-4f5b-8828-fe106ac3918e tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:25.844438 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4e064835-4f2b-4f5b-8828-fe106ac3918e tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:25.901252 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-555c7537-55cc-434b-b76a-2589a13d19e0 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094/os-volume_attachments/12ba5081-3a8a-42e1-a0ac-8cca49ee8062" status: 202 len: 0 microversion: 2.1 time: 0.727068 Apr 15 19:55:25.907349 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 245/480] 10.222.0.58 () {58 vars in 1406 bytes} [Thu Apr 15 19:55:25 2021] DELETE /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094/os-volume_attachments/12ba5081-3a8a-42e1-a0ac-8cca49ee8062 => generated 0 bytes in 734 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:55:26.338384 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-4e064835-4f2b-4f5b-8828-fe106ac3918e tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb2653fe9004615a5ecf575c999c2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bc040eb9af4c96ac478d1091ca1b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:26.354893 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-4e064835-4f2b-4f5b-8828-fe106ac3918e tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0" status: 200 len: 1319 microversion: 2.1 time: 0.551315 Apr 15 19:55:26.356225 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 236/481] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:25 2021] GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0 => generated 1319 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:55:26.369608 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-5a57a4f2-ed15-4f16-a354-42ea4f3f0803 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:26.371135 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-5a57a4f2-ed15-4f16-a354-42ea4f3f0803 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:26.399078 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5a57a4f2-ed15-4f16-a354-42ea4f3f0803 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:26.404399 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5a57a4f2-ed15-4f16-a354-42ea4f3f0803 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:26.408937 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5a57a4f2-ed15-4f16-a354-42ea4f3f0803 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:26.409672 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5a57a4f2-ed15-4f16-a354-42ea4f3f0803 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:26.624138 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-5a57a4f2-ed15-4f16-a354-42ea4f3f0803 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28667 microversion: 2.1 time: 0.255090 Apr 15 19:55:26.632987 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 246/482] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:26 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28667 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:55:27.318491 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6b0ca2d9-2d1f-41cb-a66f-4beedb421ff7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:27.319065 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6b0ca2d9-2d1f-41cb-a66f-4beedb421ff7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:27.342298 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6b0ca2d9-2d1f-41cb-a66f-4beedb421ff7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:27.345017 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6b0ca2d9-2d1f-41cb-a66f-4beedb421ff7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:27.346076 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6b0ca2d9-2d1f-41cb-a66f-4beedb421ff7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:27.350166 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6b0ca2d9-2d1f-41cb-a66f-4beedb421ff7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:27.380869 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-0230f0c9-8f4f-41cf-9a3b-6e2502b7192d tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:27.381680 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-0230f0c9-8f4f-41cf-9a3b-6e2502b7192d tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: a5f4046a-6bc2-4099-afa3-c1a2d16c38f0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:27.402459 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0230f0c9-8f4f-41cf-9a3b-6e2502b7192d tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:27.402974 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0230f0c9-8f4f-41cf-9a3b-6e2502b7192d tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:27.409174 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0230f0c9-8f4f-41cf-9a3b-6e2502b7192d tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:27.414361 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0230f0c9-8f4f-41cf-9a3b-6e2502b7192d tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:27.531585 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.objects.instance [None req-6b0ca2d9-2d1f-41cb-a66f-4beedb421ff7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lazy-loading 'flavor' on Instance uuid 6c0ac4cf-7982-406b-a2f0-115ca5721a10 {{(pid=99512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 15 19:55:28.020479 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-0230f0c9-8f4f-41cf-9a3b-6e2502b7192d tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb2653fe9004615a5ecf575c999c2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bc040eb9af4c96ac478d1091ca1b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:28.041367 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-0230f0c9-8f4f-41cf-9a3b-6e2502b7192d tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0" status: 200 len: 1319 microversion: 2.1 time: 0.662822 Apr 15 19:55:28.043023 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 247/483] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:27 2021] GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0 => generated 1319 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:55:28.055586 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a1131c45-2b8a-497d-bfeb-93a8fb93be0f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:28.056805 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a1131c45-2b8a-497d-bfeb-93a8fb93be0f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:28.091998 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a1131c45-2b8a-497d-bfeb-93a8fb93be0f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:28.092874 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a1131c45-2b8a-497d-bfeb-93a8fb93be0f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:28.098971 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a1131c45-2b8a-497d-bfeb-93a8fb93be0f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:28.099680 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a1131c45-2b8a-497d-bfeb-93a8fb93be0f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:28.349067 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a1131c45-2b8a-497d-bfeb-93a8fb93be0f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28667 microversion: 2.1 time: 0.302818 Apr 15 19:55:28.355879 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 248/484] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:28 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28667 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:55:28.377130 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6b0ca2d9-2d1f-41cb-a66f-4beedb421ff7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 202 len: 0 microversion: 2.20 time: 1.066551 Apr 15 19:55:28.377854 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 237/485] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:55:27 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 0 bytes in 1069 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 15 19:55:28.388046 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-0df76fec-5c51-4f96-bdf4-cffdec66d512 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:28.389229 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-0df76fec-5c51-4f96-bdf4-cffdec66d512 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:28.404910 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0df76fec-5c51-4f96-bdf4-cffdec66d512 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:28.408774 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0df76fec-5c51-4f96-bdf4-cffdec66d512 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:28.410276 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0df76fec-5c51-4f96-bdf4-cffdec66d512 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:28.412996 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0df76fec-5c51-4f96-bdf4-cffdec66d512 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:28.918237 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-0df76fec-5c51-4f96-bdf4-cffdec66d512 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:28.931638 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-0df76fec-5c51-4f96-bdf4-cffdec66d512 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:28.935036 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-0df76fec-5c51-4f96-bdf4-cffdec66d512 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:28.936674 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-0df76fec-5c51-4f96-bdf4-cffdec66d512 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1725 microversion: 2.20 time: 0.554021 Apr 15 19:55:28.937465 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 249/486] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:55:28 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1725 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:55:29.066992 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-3d50817f-f733-4dab-ba19-751239fa2abf tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:29.067772 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-3d50817f-f733-4dab-ba19-751239fa2abf tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: a5f4046a-6bc2-4099-afa3-c1a2d16c38f0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:29.092255 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3d50817f-f733-4dab-ba19-751239fa2abf tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:29.092768 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3d50817f-f733-4dab-ba19-751239fa2abf tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:29.093639 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3d50817f-f733-4dab-ba19-751239fa2abf tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:29.094137 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3d50817f-f733-4dab-ba19-751239fa2abf tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:29.150808 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-490bc068-3e26-4d06-bddd-89ce89399f54 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Action: 'create', calling method: .version_select at 0x7f18d8a34268>, body: {"keypair": {"name": "tempest-TestShelveInstance-2030024038"}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:29.199825 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-490bc068-3e26-4d06-bddd-89ce89399f54 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Getting quotas for project 4d9208f04bcf45e4a5d2ef86825620d3. Resources: {'key_pairs'} {{(pid=99512) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 15 19:55:29.210775 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-490bc068-3e26-4d06-bddd-89ce89399f54 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Getting quotas for user 8698c520674549bfbecfa31cd2acb852 and project 4d9208f04bcf45e4a5d2ef86825620d3. Resources: {'key_pairs'} {{(pid=99512) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 15 19:55:29.482964 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3d50817f-f733-4dab-ba19-751239fa2abf tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb2653fe9004615a5ecf575c999c2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bc040eb9af4c96ac478d1091ca1b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:29.493633 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-3d50817f-f733-4dab-ba19-751239fa2abf tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0" status: 200 len: 1319 microversion: 2.1 time: 0.437741 Apr 15 19:55:29.494567 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 250/487] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:29 2021] GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0 => generated 1319 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:55:29.500451 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7727c351-e983-4e07-b106-12b4e93602b7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:29.501758 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7727c351-e983-4e07-b106-12b4e93602b7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:29.510426 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7727c351-e983-4e07-b106-12b4e93602b7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:29.511151 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7727c351-e983-4e07-b106-12b4e93602b7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:29.512203 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7727c351-e983-4e07-b106-12b4e93602b7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:29.513117 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7727c351-e983-4e07-b106-12b4e93602b7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:29.640729 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7727c351-e983-4e07-b106-12b4e93602b7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28667 microversion: 2.1 time: 0.144616 Apr 15 19:55:29.647771 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 251/488] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:29 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28667 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:55:29.703366 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-490bc068-3e26-4d06-bddd-89ce89399f54 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Getting quotas for project 4d9208f04bcf45e4a5d2ef86825620d3. Resources: {'key_pairs'} {{(pid=99512) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 15 19:55:29.710397 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-490bc068-3e26-4d06-bddd-89ce89399f54 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Getting quotas for user 8698c520674549bfbecfa31cd2acb852 and project 4d9208f04bcf45e4a5d2ef86825620d3. Resources: {'key_pairs'} {{(pid=99512) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 15 19:55:29.749451 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-490bc068-3e26-4d06-bddd-89ce89399f54 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.887865 Apr 15 19:55:29.755066 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 238/489] 10.222.0.58 () {60 vars in 1148 bytes} [Thu Apr 15 19:55:28 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:55:29.805414 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-335a6f11-65ae-44b1-9238-bc69d1c656e4 req-9dadf6b3-9eaa-4d6b-b72e-791e6523244d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5f4046a-6bc2-4099-afa3-c1a2d16c38f0", "name": "network-vif-plugged", "status": "completed", "tag": "b4edfcb4-a2bd-4e43-83b4-3f5d12f99260"}]} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:29.807715 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:55:29.807715 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:55:29.834801 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-335a6f11-65ae-44b1-9238-bc69d1c656e4 req-9dadf6b3-9eaa-4d6b-b72e-791e6523244d service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:29.835293 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-335a6f11-65ae-44b1-9238-bc69d1c656e4 req-9dadf6b3-9eaa-4d6b-b72e-791e6523244d service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:29.899715 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-335a6f11-65ae-44b1-9238-bc69d1c656e4 req-9dadf6b3-9eaa-4d6b-b72e-791e6523244d service nova] Creating event network-vif-plugged:b4edfcb4-a2bd-4e43-83b4-3f5d12f99260 for instance a5f4046a-6bc2-4099-afa3-c1a2d16c38f0 on hv-cinder-78638 Apr 15 19:55:29.939119 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-335a6f11-65ae-44b1-9238-bc69d1c656e4 req-9dadf6b3-9eaa-4d6b-b72e-791e6523244d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117205 Apr 15 19:55:29.944309 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 252/490] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:55:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:55:29.957066 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f31c4986-6973-44c7-94ad-2abdb5bdaf52 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:29.958189 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f31c4986-6973-44c7-94ad-2abdb5bdaf52 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:29.981395 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f31c4986-6973-44c7-94ad-2abdb5bdaf52 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:29.982045 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f31c4986-6973-44c7-94ad-2abdb5bdaf52 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:29.983101 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f31c4986-6973-44c7-94ad-2abdb5bdaf52 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:29.983690 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f31c4986-6973-44c7-94ad-2abdb5bdaf52 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:30.522378 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-40ba39de-4017-44e3-9321-725de08baba8 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:30.523705 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-40ba39de-4017-44e3-9321-725de08baba8 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: a5f4046a-6bc2-4099-afa3-c1a2d16c38f0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:30.555647 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-40ba39de-4017-44e3-9321-725de08baba8 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:30.555953 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-40ba39de-4017-44e3-9321-725de08baba8 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:30.556812 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-40ba39de-4017-44e3-9321-725de08baba8 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:30.557306 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-40ba39de-4017-44e3-9321-725de08baba8 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:30.562575 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f31c4986-6973-44c7-94ad-2abdb5bdaf52 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:30.580071 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f31c4986-6973-44c7-94ad-2abdb5bdaf52 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:30.581740 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f31c4986-6973-44c7-94ad-2abdb5bdaf52 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:30.587566 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f31c4986-6973-44c7-94ad-2abdb5bdaf52 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1725 microversion: 2.20 time: 0.634444 Apr 15 19:55:30.592210 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 239/491] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:55:29 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1725 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:55:30.658576 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7af8c1a5-d1ef-478b-9ad1-e32694ebed40 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:30.660016 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7af8c1a5-d1ef-478b-9ad1-e32694ebed40 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:30.676917 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7af8c1a5-d1ef-478b-9ad1-e32694ebed40 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:30.681403 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7af8c1a5-d1ef-478b-9ad1-e32694ebed40 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:30.682691 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7af8c1a5-d1ef-478b-9ad1-e32694ebed40 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:30.683410 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7af8c1a5-d1ef-478b-9ad1-e32694ebed40 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:30.970774 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7af8c1a5-d1ef-478b-9ad1-e32694ebed40 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28667 microversion: 2.1 time: 0.315961 Apr 15 19:55:30.971921 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 240/492] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:30 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28667 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:55:31.118210 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-40ba39de-4017-44e3-9321-725de08baba8 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb2653fe9004615a5ecf575c999c2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bc040eb9af4c96ac478d1091ca1b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:31.137646 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-40ba39de-4017-44e3-9321-725de08baba8 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0" status: 200 len: 1319 microversion: 2.1 time: 0.625911 Apr 15 19:55:31.138347 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 253/493] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:30 2021] GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0 => generated 1319 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:55:31.611056 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c4148eae-5ee5-4f68-8c5c-9330403464e6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:31.612032 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c4148eae-5ee5-4f68-8c5c-9330403464e6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:31.620939 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c4148eae-5ee5-4f68-8c5c-9330403464e6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:31.621687 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c4148eae-5ee5-4f68-8c5c-9330403464e6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:31.622763 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c4148eae-5ee5-4f68-8c5c-9330403464e6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:31.623445 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c4148eae-5ee5-4f68-8c5c-9330403464e6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:31.982736 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-04677bbb-71ea-4e05-a53e-e29bee337692 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:31.984117 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-04677bbb-71ea-4e05-a53e-e29bee337692 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:31.996861 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-04677bbb-71ea-4e05-a53e-e29bee337692 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:32.000744 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-04677bbb-71ea-4e05-a53e-e29bee337692 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:32.001820 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-04677bbb-71ea-4e05-a53e-e29bee337692 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:32.002489 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-04677bbb-71ea-4e05-a53e-e29bee337692 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:32.138363 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c4148eae-5ee5-4f68-8c5c-9330403464e6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:32.163750 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c4148eae-5ee5-4f68-8c5c-9330403464e6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:32.165454 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c4148eae-5ee5-4f68-8c5c-9330403464e6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:32.166976 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c4148eae-5ee5-4f68-8c5c-9330403464e6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1725 microversion: 2.20 time: 0.560258 Apr 15 19:55:32.207661 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 241/494] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:55:31 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1725 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:55:32.218150 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-51687a3c-c53f-475c-b97b-5b9dc129b472 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:32.218840 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-51687a3c-c53f-475c-b97b-5b9dc129b472 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: a5f4046a-6bc2-4099-afa3-c1a2d16c38f0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:32.245583 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-51687a3c-c53f-475c-b97b-5b9dc129b472 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:32.246094 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-51687a3c-c53f-475c-b97b-5b9dc129b472 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:32.246960 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-51687a3c-c53f-475c-b97b-5b9dc129b472 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:32.248062 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-51687a3c-c53f-475c-b97b-5b9dc129b472 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:32.881695 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-51687a3c-c53f-475c-b97b-5b9dc129b472 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb2653fe9004615a5ecf575c999c2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bc040eb9af4c96ac478d1091ca1b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:32.895225 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-51687a3c-c53f-475c-b97b-5b9dc129b472 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0" status: 200 len: 1508 microversion: 2.1 time: 0.686024 Apr 15 19:55:32.904360 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 242/495] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:32 2021] GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0 => generated 1508 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:55:33.206006 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-bac392e5-728c-44f9-b4d6-fa369df38109 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:33.208065 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-bac392e5-728c-44f9-b4d6-fa369df38109 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:33.245487 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bac392e5-728c-44f9-b4d6-fa369df38109 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:33.245995 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bac392e5-728c-44f9-b4d6-fa369df38109 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:33.249690 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bac392e5-728c-44f9-b4d6-fa369df38109 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:33.250216 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bac392e5-728c-44f9-b4d6-fa369df38109 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:33.806924 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-bac392e5-728c-44f9-b4d6-fa369df38109 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:33.818244 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-bac392e5-728c-44f9-b4d6-fa369df38109 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:33.825992 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-bac392e5-728c-44f9-b4d6-fa369df38109 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:33.827320 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-bac392e5-728c-44f9-b4d6-fa369df38109 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1725 microversion: 2.20 time: 0.628497 Apr 15 19:55:33.827949 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 243/496] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:55:33 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1725 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:55:34.846549 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-07408f29-77f0-4343-9aba-b7bd206143bf tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:34.848153 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-07408f29-77f0-4343-9aba-b7bd206143bf tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:34.858777 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-07408f29-77f0-4343-9aba-b7bd206143bf tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:34.859837 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-07408f29-77f0-4343-9aba-b7bd206143bf tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:34.860922 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-07408f29-77f0-4343-9aba-b7bd206143bf tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:34.861892 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-07408f29-77f0-4343-9aba-b7bd206143bf tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:35.100697 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-07408f29-77f0-4343-9aba-b7bd206143bf tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:35.113313 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-07408f29-77f0-4343-9aba-b7bd206143bf tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:35.115210 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-07408f29-77f0-4343-9aba-b7bd206143bf tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:35.116775 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-07408f29-77f0-4343-9aba-b7bd206143bf tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1725 microversion: 2.20 time: 0.274464 Apr 15 19:55:35.117645 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 244/497] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:55:34 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1725 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 19:55:35.665757 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-04677bbb-71ea-4e05-a53e-e29bee337692 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28667 microversion: 2.1 time: 3.687020 Apr 15 19:55:35.666809 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 254/498] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:31 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28667 bytes in 3689 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:55:36.138523 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-0db51298-b5f7-4604-884d-6efe0301416b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:36.139237 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-0db51298-b5f7-4604-884d-6efe0301416b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:36.161729 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0db51298-b5f7-4604-884d-6efe0301416b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:36.162246 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0db51298-b5f7-4604-884d-6efe0301416b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:36.171517 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0db51298-b5f7-4604-884d-6efe0301416b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:36.172287 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0db51298-b5f7-4604-884d-6efe0301416b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:36.504637 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-0db51298-b5f7-4604-884d-6efe0301416b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:36.517668 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-0db51298-b5f7-4604-884d-6efe0301416b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:36.519660 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-0db51298-b5f7-4604-884d-6efe0301416b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:36.521557 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-0db51298-b5f7-4604-884d-6efe0301416b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1725 microversion: 2.20 time: 0.387756 Apr 15 19:55:36.533712 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 245/499] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:55:36 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1725 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:55:36.680850 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-4b92ac29-8271-4a75-84ec-160b92d4320d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:36.689899 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-4b92ac29-8271-4a75-84ec-160b92d4320d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:36.707569 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4b92ac29-8271-4a75-84ec-160b92d4320d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:36.708252 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4b92ac29-8271-4a75-84ec-160b92d4320d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:36.709369 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4b92ac29-8271-4a75-84ec-160b92d4320d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:36.711015 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4b92ac29-8271-4a75-84ec-160b92d4320d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:36.885143 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-4b92ac29-8271-4a75-84ec-160b92d4320d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28667 microversion: 2.1 time: 0.208780 Apr 15 19:55:36.886357 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 255/500] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:36 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28667 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 15 19:55:37.542317 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-90686934-a064-4995-929b-a5ff425c8c07 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:37.542953 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-90686934-a064-4995-929b-a5ff425c8c07 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:37.550923 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-90686934-a064-4995-929b-a5ff425c8c07 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:37.551730 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-90686934-a064-4995-929b-a5ff425c8c07 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:37.552752 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-90686934-a064-4995-929b-a5ff425c8c07 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:37.553390 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-90686934-a064-4995-929b-a5ff425c8c07 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:37.809261 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-90686934-a064-4995-929b-a5ff425c8c07 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:37.822237 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-90686934-a064-4995-929b-a5ff425c8c07 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:37.824251 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-90686934-a064-4995-929b-a5ff425c8c07 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:37.826128 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-90686934-a064-4995-929b-a5ff425c8c07 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1725 microversion: 2.20 time: 0.287945 Apr 15 19:55:37.827303 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 246/501] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:55:37 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1725 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:55:37.899677 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-42e65609-55ed-4cf3-9083-9b37ae80b86c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:37.901020 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-42e65609-55ed-4cf3-9083-9b37ae80b86c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:37.914484 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-42e65609-55ed-4cf3-9083-9b37ae80b86c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:37.929337 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-42e65609-55ed-4cf3-9083-9b37ae80b86c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:37.930630 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-42e65609-55ed-4cf3-9083-9b37ae80b86c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:37.931161 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-42e65609-55ed-4cf3-9083-9b37ae80b86c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:38.085840 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-42e65609-55ed-4cf3-9083-9b37ae80b86c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28667 microversion: 2.1 time: 0.191101 Apr 15 19:55:38.087428 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 256/502] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:37 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28667 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:55:38.848269 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-92c77ca3-c5ec-45c0-8c93-79ccec109e4c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:38.849106 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-92c77ca3-c5ec-45c0-8c93-79ccec109e4c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:38.861425 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-92c77ca3-c5ec-45c0-8c93-79ccec109e4c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:38.862243 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-92c77ca3-c5ec-45c0-8c93-79ccec109e4c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:38.863343 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-92c77ca3-c5ec-45c0-8c93-79ccec109e4c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:38.866011 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-92c77ca3-c5ec-45c0-8c93-79ccec109e4c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:39.102967 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-71885389-0bcf-45fb-b25a-30134b594acd tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:39.104261 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-71885389-0bcf-45fb-b25a-30134b594acd tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:39.118113 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-71885389-0bcf-45fb-b25a-30134b594acd tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:39.118775 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-71885389-0bcf-45fb-b25a-30134b594acd tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:39.122376 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-71885389-0bcf-45fb-b25a-30134b594acd tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:39.134433 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-71885389-0bcf-45fb-b25a-30134b594acd tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:39.268993 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-71885389-0bcf-45fb-b25a-30134b594acd tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28667 microversion: 2.1 time: 0.173742 Apr 15 19:55:39.276210 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 257/503] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:39 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28667 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:55:39.300939 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-92c77ca3-c5ec-45c0-8c93-79ccec109e4c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:39.313386 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-92c77ca3-c5ec-45c0-8c93-79ccec109e4c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:39.317568 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-92c77ca3-c5ec-45c0-8c93-79ccec109e4c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:39.317568 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-92c77ca3-c5ec-45c0-8c93-79ccec109e4c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1725 microversion: 2.20 time: 0.472667 Apr 15 19:55:39.319178 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 247/504] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:55:38 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1725 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:55:39.609389 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-73f17f2b-95ea-4d50-b503-a8cddff985f5 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:39.610633 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-73f17f2b-95ea-4d50-b503-a8cddff985f5 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:39.636295 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-73f17f2b-95ea-4d50-b503-a8cddff985f5 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:39.639413 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-73f17f2b-95ea-4d50-b503-a8cddff985f5 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:39.651111 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-73f17f2b-95ea-4d50-b503-a8cddff985f5 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:39.652011 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-73f17f2b-95ea-4d50-b503-a8cddff985f5 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:39.792714 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-73f17f2b-95ea-4d50-b503-a8cddff985f5 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Going to try to terminate instance {{(pid=99511) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 15 19:55:40.007888 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-73f17f2b-95ea-4d50-b503-a8cddff985f5 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 204 len: 0 microversion: 2.1 time: 0.402941 Apr 15 19:55:40.008973 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 258/505] 10.222.0.58 () {58 vars in 1229 bytes} [Thu Apr 15 19:55:39 2021] DELETE /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 15 19:55:40.018177 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c3b86dd5-59f9-43ca-89d3-e64f8f3f9696 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:40.018856 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c3b86dd5-59f9-43ca-89d3-e64f8f3f9696 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:40.034767 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c3b86dd5-59f9-43ca-89d3-e64f8f3f9696 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:40.035553 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c3b86dd5-59f9-43ca-89d3-e64f8f3f9696 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:40.036892 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c3b86dd5-59f9-43ca-89d3-e64f8f3f9696 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:40.038138 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c3b86dd5-59f9-43ca-89d3-e64f8f3f9696 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:40.291089 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f09aeef7-5398-47ac-8fa2-9e989419181f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:40.293096 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f09aeef7-5398-47ac-8fa2-9e989419181f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:40.310585 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f09aeef7-5398-47ac-8fa2-9e989419181f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:40.311844 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f09aeef7-5398-47ac-8fa2-9e989419181f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:40.317726 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f09aeef7-5398-47ac-8fa2-9e989419181f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:40.318464 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f09aeef7-5398-47ac-8fa2-9e989419181f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:40.354630 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c3b86dd5-59f9-43ca-89d3-e64f8f3f9696 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:40.366920 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c3b86dd5-59f9-43ca-89d3-e64f8f3f9696 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1507 microversion: 2.1 time: 0.353562 Apr 15 19:55:40.369563 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 248/506] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:40 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1507 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:55:40.379499 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-0bee5baf-838c-4883-be19-8e9e69043d67 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:40.382755 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-0bee5baf-838c-4883-be19-8e9e69043d67 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:40.401374 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0bee5baf-838c-4883-be19-8e9e69043d67 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:40.402208 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0bee5baf-838c-4883-be19-8e9e69043d67 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:40.406827 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0bee5baf-838c-4883-be19-8e9e69043d67 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:40.407824 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0bee5baf-838c-4883-be19-8e9e69043d67 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:40.492359 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f09aeef7-5398-47ac-8fa2-9e989419181f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28667 microversion: 2.1 time: 0.205525 Apr 15 19:55:40.493441 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 259/507] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:40 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28667 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:55:40.654211 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-0bee5baf-838c-4883-be19-8e9e69043d67 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:40.665669 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-0bee5baf-838c-4883-be19-8e9e69043d67 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:40.667947 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-0bee5baf-838c-4883-be19-8e9e69043d67 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:40.669572 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-0bee5baf-838c-4883-be19-8e9e69043d67 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1725 microversion: 2.20 time: 0.294641 Apr 15 19:55:40.670282 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 249/508] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:55:40 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1725 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:55:40.830257 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-042ea830-6416-46dd-893f-2b0db69116cf tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Action: 'create', calling method: .version_select at 0x7f18d80d5e18>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-23103788"}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:40.857401 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-042ea830-6416-46dd-893f-2b0db69116cf tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Getting quotas for project c4982826645345ceb30d47046d10f317. Resources: {'key_pairs'} {{(pid=99511) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 15 19:55:40.861726 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-042ea830-6416-46dd-893f-2b0db69116cf tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Getting quotas for user 14fc42f165ba4963903dc11f69ab6ab5 and project c4982826645345ceb30d47046d10f317. Resources: {'key_pairs'} {{(pid=99511) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 15 19:55:41.030179 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-042ea830-6416-46dd-893f-2b0db69116cf tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Getting quotas for project c4982826645345ceb30d47046d10f317. Resources: {'key_pairs'} {{(pid=99511) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 15 19:55:41.034192 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-042ea830-6416-46dd-893f-2b0db69116cf tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Getting quotas for user 14fc42f165ba4963903dc11f69ab6ab5 and project c4982826645345ceb30d47046d10f317. Resources: {'key_pairs'} {{(pid=99511) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 15 19:55:41.048082 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-042ea830-6416-46dd-893f-2b0db69116cf tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 2320 microversion: 2.1 time: 0.224533 Apr 15 19:55:41.048908 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 260/509] 10.222.0.58 () {60 vars in 1148 bytes} [Thu Apr 15 19:55:40 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:55:41.108109 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ffd2c301-04ef-4088-b9f5-be3042c45d22 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1943251946", "imageRef": "8ab90366-da9b-4255-a335-f1c43da0bd11", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-23103788", "networks": [{"uuid": "d2e11d43-a253-422d-a44e-09304a48dfbf"}]}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:41.394086 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-3c9928d3-bd85-4ed7-9474-e76e7f364e5b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:41.394892 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-3c9928d3-bd85-4ed7-9474-e76e7f364e5b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:41.403186 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3c9928d3-bd85-4ed7-9474-e76e7f364e5b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:41.403727 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3c9928d3-bd85-4ed7-9474-e76e7f364e5b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:41.404562 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3c9928d3-bd85-4ed7-9474-e76e7f364e5b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:41.405100 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3c9928d3-bd85-4ed7-9474-e76e7f364e5b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:41.628419 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3c9928d3-bd85-4ed7-9474-e76e7f364e5b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:41.638147 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-3c9928d3-bd85-4ed7-9474-e76e7f364e5b tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1507 microversion: 2.1 time: 0.248050 Apr 15 19:55:41.639100 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 261/510] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:41 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1507 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:55:41.644659 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7af586d2-05da-4537-a1df-631c8f6923ca tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:41.645821 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7af586d2-05da-4537-a1df-631c8f6923ca tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:41.658753 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7af586d2-05da-4537-a1df-631c8f6923ca tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:41.659382 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7af586d2-05da-4537-a1df-631c8f6923ca tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:41.660262 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7af586d2-05da-4537-a1df-631c8f6923ca tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:41.660753 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7af586d2-05da-4537-a1df-631c8f6923ca tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:41.793671 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7af586d2-05da-4537-a1df-631c8f6923ca tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28667 microversion: 2.1 time: 0.153005 Apr 15 19:55:41.795211 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 262/511] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:41 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28667 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:55:41.800973 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-fe27caee-b25f-4b88-9124-67048a9a07a3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:41.801743 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-fe27caee-b25f-4b88-9124-67048a9a07a3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:41.810482 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fe27caee-b25f-4b88-9124-67048a9a07a3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:41.811000 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fe27caee-b25f-4b88-9124-67048a9a07a3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:41.811918 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fe27caee-b25f-4b88-9124-67048a9a07a3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:41.812409 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fe27caee-b25f-4b88-9124-67048a9a07a3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:42.031920 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-fe27caee-b25f-4b88-9124-67048a9a07a3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:42.041640 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-fe27caee-b25f-4b88-9124-67048a9a07a3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:42.043334 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-fe27caee-b25f-4b88-9124-67048a9a07a3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:42.044593 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-fe27caee-b25f-4b88-9124-67048a9a07a3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1725 microversion: 2.20 time: 0.247953 Apr 15 19:55:42.045200 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 263/512] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:55:41 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1725 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:55:42.656985 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ef193fd6-f99e-4d5a-afbf-a88b311fd106 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:42.657756 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ef193fd6-f99e-4d5a-afbf-a88b311fd106 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:42.665767 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ef193fd6-f99e-4d5a-afbf-a88b311fd106 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:42.666881 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ef193fd6-f99e-4d5a-afbf-a88b311fd106 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:42.667768 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ef193fd6-f99e-4d5a-afbf-a88b311fd106 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:42.668437 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ef193fd6-f99e-4d5a-afbf-a88b311fd106 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:42.966506 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ef193fd6-f99e-4d5a-afbf-a88b311fd106 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:42.975529 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ef193fd6-f99e-4d5a-afbf-a88b311fd106 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1507 microversion: 2.1 time: 0.323237 Apr 15 19:55:42.976132 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 264/513] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:42 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1507 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:55:42.981252 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-527a02e5-7fb5-4a5c-941b-c95e8251eec9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:42.982757 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-527a02e5-7fb5-4a5c-941b-c95e8251eec9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:42.990519 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-527a02e5-7fb5-4a5c-941b-c95e8251eec9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:42.991029 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-527a02e5-7fb5-4a5c-941b-c95e8251eec9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:42.991897 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-527a02e5-7fb5-4a5c-941b-c95e8251eec9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:42.992445 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-527a02e5-7fb5-4a5c-941b-c95e8251eec9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:43.115908 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-527a02e5-7fb5-4a5c-941b-c95e8251eec9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28667 microversion: 2.1 time: 0.138136 Apr 15 19:55:43.116851 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 265/514] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:42 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28667 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:55:43.122642 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-152603f9-b030-447b-b047-2e893c888e25 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:43.123423 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-152603f9-b030-447b-b047-2e893c888e25 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:43.131910 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-152603f9-b030-447b-b047-2e893c888e25 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:43.132420 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-152603f9-b030-447b-b047-2e893c888e25 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:43.133254 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-152603f9-b030-447b-b047-2e893c888e25 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:43.133744 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-152603f9-b030-447b-b047-2e893c888e25 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:43.480251 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-152603f9-b030-447b-b047-2e893c888e25 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:43.491399 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-152603f9-b030-447b-b047-2e893c888e25 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:43.493101 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-152603f9-b030-447b-b047-2e893c888e25 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:43.494331 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-152603f9-b030-447b-b047-2e893c888e25 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1725 microversion: 2.20 time: 0.375994 Apr 15 19:55:43.495136 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 266/515] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:55:43 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1725 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:55:43.993611 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e2f836ad-09a0-4c11-a7fa-a739ec73c0e0 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:43.994329 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e2f836ad-09a0-4c11-a7fa-a739ec73c0e0 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:44.002948 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e2f836ad-09a0-4c11-a7fa-a739ec73c0e0 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:44.003508 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e2f836ad-09a0-4c11-a7fa-a739ec73c0e0 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:44.004354 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e2f836ad-09a0-4c11-a7fa-a739ec73c0e0 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:44.004848 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e2f836ad-09a0-4c11-a7fa-a739ec73c0e0 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:44.219113 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-e2f836ad-09a0-4c11-a7fa-a739ec73c0e0 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:44.230430 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e2f836ad-09a0-4c11-a7fa-a739ec73c0e0 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 200 len: 1465 microversion: 2.1 time: 0.239599 Apr 15 19:55:44.238516 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 267/516] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:43 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 1465 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:55:44.238516 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-cf77b23d-be30-4fc2-82f4-2b806befdcc0 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:44.238516 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-cf77b23d-be30-4fc2-82f4-2b806befdcc0 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:44.246507 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cf77b23d-be30-4fc2-82f4-2b806befdcc0 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:44.247603 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cf77b23d-be30-4fc2-82f4-2b806befdcc0 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:44.248468 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cf77b23d-be30-4fc2-82f4-2b806befdcc0 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:44.248969 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cf77b23d-be30-4fc2-82f4-2b806befdcc0 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:44.791520 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-cf77b23d-be30-4fc2-82f4-2b806befdcc0 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28667 microversion: 2.1 time: 0.557739 Apr 15 19:55:44.792216 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 268/517] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:44 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28667 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:55:44.798284 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-7af6fc30-b445-4c93-8eef-ba90e23f9de1 req-4384fde0-25fc-4aae-9156-c47391cea595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c5511dc-7635-490f-86b8-2a3c15d4d90e", "name": "network-vif-deleted", "tag": "abc0c4ce-b998-4acc-9da8-075ad1fe41bd"}]} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:44.799935 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:55:44.799935 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:55:44.809513 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-7af6fc30-b445-4c93-8eef-ba90e23f9de1 req-4384fde0-25fc-4aae-9156-c47391cea595 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:44.810007 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-7af6fc30-b445-4c93-8eef-ba90e23f9de1 req-4384fde0-25fc-4aae-9156-c47391cea595 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:44.826893 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-7af6fc30-b445-4c93-8eef-ba90e23f9de1 req-4384fde0-25fc-4aae-9156-c47391cea595 service nova] Creating event network-vif-deleted:abc0c4ce-b998-4acc-9da8-075ad1fe41bd for instance 3c5511dc-7635-490f-86b8-2a3c15d4d90e on hv-cinder-78638 Apr 15 19:55:44.831886 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-7af6fc30-b445-4c93-8eef-ba90e23f9de1 req-4384fde0-25fc-4aae-9156-c47391cea595 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038242 Apr 15 19:55:44.832461 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 269/518] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:55:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:55:44.837681 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-adb2c1e2-1c25-4763-ada1-f2454752cb95 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:44.838441 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-adb2c1e2-1c25-4763-ada1-f2454752cb95 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:44.847035 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-adb2c1e2-1c25-4763-ada1-f2454752cb95 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:44.847535 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-adb2c1e2-1c25-4763-ada1-f2454752cb95 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:44.848392 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-adb2c1e2-1c25-4763-ada1-f2454752cb95 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:44.848964 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-adb2c1e2-1c25-4763-ada1-f2454752cb95 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:45.072746 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-adb2c1e2-1c25-4763-ada1-f2454752cb95 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:45.084119 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-adb2c1e2-1c25-4763-ada1-f2454752cb95 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:45.085812 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-adb2c1e2-1c25-4763-ada1-f2454752cb95 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:45.087103 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-adb2c1e2-1c25-4763-ada1-f2454752cb95 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1725 microversion: 2.20 time: 0.253498 Apr 15 19:55:45.087794 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 270/519] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:55:44 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1725 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:55:45.249681 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b168c4c3-4871-40bf-9ffd-22a3dfbd34ea tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:45.250358 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b168c4c3-4871-40bf-9ffd-22a3dfbd34ea tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 3c5511dc-7635-490f-86b8-2a3c15d4d90e] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:45.258377 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b168c4c3-4871-40bf-9ffd-22a3dfbd34ea tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:45.258870 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b168c4c3-4871-40bf-9ffd-22a3dfbd34ea tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:45.259750 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b168c4c3-4871-40bf-9ffd-22a3dfbd34ea tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:45.260253 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b168c4c3-4871-40bf-9ffd-22a3dfbd34ea tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:45.316572 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-b168c4c3-4871-40bf-9ffd-22a3dfbd34ea tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] HTTP exception thrown: Instance 3c5511dc-7635-490f-86b8-2a3c15d4d90e could not be found. Apr 15 19:55:45.317305 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b168c4c3-4871-40bf-9ffd-22a3dfbd34ea tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Returning 404 to user: Instance 3c5511dc-7635-490f-86b8-2a3c15d4d90e could not be found. {{(pid=99511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 19:55:45.318256 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b168c4c3-4871-40bf-9ffd-22a3dfbd34ea tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e" status: 404 len: 111 microversion: 2.1 time: 0.073292 Apr 15 19:55:45.319056 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 271/520] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:45 2021] GET /compute/v2.1/servers/3c5511dc-7635-490f-86b8-2a3c15d4d90e => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 15 19:55:45.329122 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e19d12f9-8ddf-47da-bf65-9e352ec17c02 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:45.329678 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e19d12f9-8ddf-47da-bf65-9e352ec17c02 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:45.337713 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e19d12f9-8ddf-47da-bf65-9e352ec17c02 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:45.338218 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e19d12f9-8ddf-47da-bf65-9e352ec17c02 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:45.339055 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e19d12f9-8ddf-47da-bf65-9e352ec17c02 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:45.339573 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e19d12f9-8ddf-47da-bf65-9e352ec17c02 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:45.409890 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e19d12f9-8ddf-47da-bf65-9e352ec17c02 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Going to try to terminate instance {{(pid=99511) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 15 19:55:45.528297 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e19d12f9-8ddf-47da-bf65-9e352ec17c02 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 204 len: 0 microversion: 2.1 time: 0.204410 Apr 15 19:55:45.528972 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 272/521] 10.222.0.58 () {58 vars in 1229 bytes} [Thu Apr 15 19:55:45 2021] DELETE /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 15 19:55:45.538653 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7c9e67e8-a7dc-4e13-976a-723ee69711b6 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:45.539446 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7c9e67e8-a7dc-4e13-976a-723ee69711b6 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:45.547594 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7c9e67e8-a7dc-4e13-976a-723ee69711b6 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:45.548106 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7c9e67e8-a7dc-4e13-976a-723ee69711b6 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:45.548935 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7c9e67e8-a7dc-4e13-976a-723ee69711b6 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:45.549431 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7c9e67e8-a7dc-4e13-976a-723ee69711b6 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:45.782548 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-7c9e67e8-a7dc-4e13-976a-723ee69711b6 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:45.792050 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7c9e67e8-a7dc-4e13-976a-723ee69711b6 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1522 microversion: 2.1 time: 0.258182 Apr 15 19:55:45.792668 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 273/522] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:45 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:55:45.804102 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-384ac64a-ec37-493e-ad01-7cdf15a3469b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:45.805134 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-384ac64a-ec37-493e-ad01-7cdf15a3469b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:45.815021 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-384ac64a-ec37-493e-ad01-7cdf15a3469b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:45.815597 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-384ac64a-ec37-493e-ad01-7cdf15a3469b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:45.816445 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-384ac64a-ec37-493e-ad01-7cdf15a3469b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:45.816941 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-384ac64a-ec37-493e-ad01-7cdf15a3469b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:45.942550 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-384ac64a-ec37-493e-ad01-7cdf15a3469b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28667 microversion: 2.1 time: 0.141873 Apr 15 19:55:45.943189 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 274/523] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:45 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28667 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 15 19:55:46.108872 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-0521821d-00b6-4437-aa76-4af9b3e996d6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:46.109639 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-0521821d-00b6-4437-aa76-4af9b3e996d6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:46.118553 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0521821d-00b6-4437-aa76-4af9b3e996d6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:46.119060 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0521821d-00b6-4437-aa76-4af9b3e996d6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:46.120171 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0521821d-00b6-4437-aa76-4af9b3e996d6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:46.120670 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0521821d-00b6-4437-aa76-4af9b3e996d6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:46.337388 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-0521821d-00b6-4437-aa76-4af9b3e996d6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:46.348188 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-0521821d-00b6-4437-aa76-4af9b3e996d6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:46.349900 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-0521821d-00b6-4437-aa76-4af9b3e996d6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:46.351154 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-0521821d-00b6-4437-aa76-4af9b3e996d6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1746 microversion: 2.20 time: 0.247563 Apr 15 19:55:46.351811 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 275/524] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:55:46 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1746 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 19:55:46.810795 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-1aef15b8-2322-4756-bff9-060089e6850f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:46.811537 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-1aef15b8-2322-4756-bff9-060089e6850f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:46.819551 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1aef15b8-2322-4756-bff9-060089e6850f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:46.820062 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1aef15b8-2322-4756-bff9-060089e6850f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:46.820906 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1aef15b8-2322-4756-bff9-060089e6850f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:46.821395 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1aef15b8-2322-4756-bff9-060089e6850f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:47.038521 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-1aef15b8-2322-4756-bff9-060089e6850f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:47.047855 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-1aef15b8-2322-4756-bff9-060089e6850f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1522 microversion: 2.1 time: 0.241653 Apr 15 19:55:47.048479 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 276/525] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:46 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:55:47.053387 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-4b973a45-7a83-4717-bd0e-7001cf67a692 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:47.054678 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-4b973a45-7a83-4717-bd0e-7001cf67a692 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:47.063774 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4b973a45-7a83-4717-bd0e-7001cf67a692 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:47.064299 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4b973a45-7a83-4717-bd0e-7001cf67a692 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:47.065159 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4b973a45-7a83-4717-bd0e-7001cf67a692 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:47.065662 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4b973a45-7a83-4717-bd0e-7001cf67a692 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:47.176007 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-4b973a45-7a83-4717-bd0e-7001cf67a692 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28667 microversion: 2.1 time: 0.126094 Apr 15 19:55:47.180243 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 277/526] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:47 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28667 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:55:47.372987 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-40c800f0-6bee-43b7-b75f-3144dded6538 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:47.373897 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-40c800f0-6bee-43b7-b75f-3144dded6538 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:47.382583 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-40c800f0-6bee-43b7-b75f-3144dded6538 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:47.383096 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-40c800f0-6bee-43b7-b75f-3144dded6538 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:47.384060 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-40c800f0-6bee-43b7-b75f-3144dded6538 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:47.384562 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-40c800f0-6bee-43b7-b75f-3144dded6538 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:47.822508 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-40c800f0-6bee-43b7-b75f-3144dded6538 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:47.831832 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-40c800f0-6bee-43b7-b75f-3144dded6538 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:47.833458 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-40c800f0-6bee-43b7-b75f-3144dded6538 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:47.834680 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-40c800f0-6bee-43b7-b75f-3144dded6538 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1746 microversion: 2.20 time: 0.467242 Apr 15 19:55:47.835303 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 278/527] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:55:47 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1746 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 19:55:48.064868 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f53ced09-0a95-47d7-a098-3dc72f39d549 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:48.065545 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f53ced09-0a95-47d7-a098-3dc72f39d549 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:48.073469 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f53ced09-0a95-47d7-a098-3dc72f39d549 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:48.073992 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f53ced09-0a95-47d7-a098-3dc72f39d549 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:48.074842 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f53ced09-0a95-47d7-a098-3dc72f39d549 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:48.075876 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f53ced09-0a95-47d7-a098-3dc72f39d549 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:48.290313 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f53ced09-0a95-47d7-a098-3dc72f39d549 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:48.299473 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f53ced09-0a95-47d7-a098-3dc72f39d549 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1522 microversion: 2.1 time: 0.238616 Apr 15 19:55:48.300089 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 279/528] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:48 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:55:48.304793 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-bdcdf594-63ad-4cb5-b323-51afa3fa4b0e tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:48.305853 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-bdcdf594-63ad-4cb5-b323-51afa3fa4b0e tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:48.314481 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bdcdf594-63ad-4cb5-b323-51afa3fa4b0e tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:48.314982 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bdcdf594-63ad-4cb5-b323-51afa3fa4b0e tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:48.315851 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bdcdf594-63ad-4cb5-b323-51afa3fa4b0e tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:48.316341 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bdcdf594-63ad-4cb5-b323-51afa3fa4b0e tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:48.417552 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-bdcdf594-63ad-4cb5-b323-51afa3fa4b0e tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28667 microversion: 2.1 time: 0.116119 Apr 15 19:55:48.418217 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 280/529] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:48 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28667 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:55:48.855905 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-3550a55a-e330-40fe-b564-8d47bdaa17b4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:48.856688 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-3550a55a-e330-40fe-b564-8d47bdaa17b4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:48.865805 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3550a55a-e330-40fe-b564-8d47bdaa17b4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:48.866322 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3550a55a-e330-40fe-b564-8d47bdaa17b4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:48.867168 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3550a55a-e330-40fe-b564-8d47bdaa17b4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:48.867692 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3550a55a-e330-40fe-b564-8d47bdaa17b4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:49.092858 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3550a55a-e330-40fe-b564-8d47bdaa17b4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:49.101826 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3550a55a-e330-40fe-b564-8d47bdaa17b4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:49.103526 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3550a55a-e330-40fe-b564-8d47bdaa17b4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:49.104763 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-3550a55a-e330-40fe-b564-8d47bdaa17b4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1746 microversion: 2.20 time: 0.253651 Apr 15 19:55:49.105387 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 281/530] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:55:48 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1746 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:55:49.317502 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-81fbfce7-2825-4b4a-b9f1-d0aa7e78228a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:49.318286 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-81fbfce7-2825-4b4a-b9f1-d0aa7e78228a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:49.326150 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-81fbfce7-2825-4b4a-b9f1-d0aa7e78228a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:49.327208 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-81fbfce7-2825-4b4a-b9f1-d0aa7e78228a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:49.328062 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-81fbfce7-2825-4b4a-b9f1-d0aa7e78228a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:49.328559 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-81fbfce7-2825-4b4a-b9f1-d0aa7e78228a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:49.548476 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-81fbfce7-2825-4b4a-b9f1-d0aa7e78228a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:49.557969 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-81fbfce7-2825-4b4a-b9f1-d0aa7e78228a tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1522 microversion: 2.1 time: 0.244523 Apr 15 19:55:49.558605 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 282/531] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:49 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:55:49.563665 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-abdedb42-f779-4b8f-aa58-d21aed982175 req-147d433c-9f42-4cda-99d3-4a8b3145c8ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0ac4cf-7982-406b-a2f0-115ca5721a10", "name": "network-vif-plugged", "status": "completed", "tag": "431c18ae-c617-4e1e-bca6-7134661c98e1"}]} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:49.565340 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:55:49.565340 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:55:49.573940 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-abdedb42-f779-4b8f-aa58-d21aed982175 req-147d433c-9f42-4cda-99d3-4a8b3145c8ab service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:49.574388 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-abdedb42-f779-4b8f-aa58-d21aed982175 req-147d433c-9f42-4cda-99d3-4a8b3145c8ab service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:49.594117 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-abdedb42-f779-4b8f-aa58-d21aed982175 req-147d433c-9f42-4cda-99d3-4a8b3145c8ab service nova] Creating event network-vif-plugged:431c18ae-c617-4e1e-bca6-7134661c98e1 for instance 6c0ac4cf-7982-406b-a2f0-115ca5721a10 on hv-cinder-78638 Apr 15 19:55:49.599254 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-abdedb42-f779-4b8f-aa58-d21aed982175 req-147d433c-9f42-4cda-99d3-4a8b3145c8ab service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039355 Apr 15 19:55:49.600004 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 283/532] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:55:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:55:49.605367 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-35828dd2-1aac-432c-b4dc-73d63324da98 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:49.606478 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-35828dd2-1aac-432c-b4dc-73d63324da98 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:49.614367 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-35828dd2-1aac-432c-b4dc-73d63324da98 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:49.614877 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-35828dd2-1aac-432c-b4dc-73d63324da98 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:49.615854 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-35828dd2-1aac-432c-b4dc-73d63324da98 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:49.616354 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-35828dd2-1aac-432c-b4dc-73d63324da98 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:49.733660 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-35828dd2-1aac-432c-b4dc-73d63324da98 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28667 microversion: 2.1 time: 0.132093 Apr 15 19:55:49.734393 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 284/533] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:49 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28667 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:55:50.126079 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-3584307a-1f9f-4e71-88cc-06640af51f95 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:50.126853 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-3584307a-1f9f-4e71-88cc-06640af51f95 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:50.135865 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3584307a-1f9f-4e71-88cc-06640af51f95 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:50.136526 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3584307a-1f9f-4e71-88cc-06640af51f95 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:50.137176 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3584307a-1f9f-4e71-88cc-06640af51f95 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:50.137673 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3584307a-1f9f-4e71-88cc-06640af51f95 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:50.355948 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3584307a-1f9f-4e71-88cc-06640af51f95 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:50.366453 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3584307a-1f9f-4e71-88cc-06640af51f95 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:50.368159 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3584307a-1f9f-4e71-88cc-06640af51f95 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:50.369394 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-3584307a-1f9f-4e71-88cc-06640af51f95 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1746 microversion: 2.20 time: 0.248767 Apr 15 19:55:50.370014 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 285/534] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:55:50 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1746 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 19:55:50.576101 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-42332756-08ea-4f0b-b361-c8fdbf28d46d tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:50.576777 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-42332756-08ea-4f0b-b361-c8fdbf28d46d tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:50.586423 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-42332756-08ea-4f0b-b361-c8fdbf28d46d tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:50.586929 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-42332756-08ea-4f0b-b361-c8fdbf28d46d tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:50.587801 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-42332756-08ea-4f0b-b361-c8fdbf28d46d tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:50.588290 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-42332756-08ea-4f0b-b361-c8fdbf28d46d tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:50.804440 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-42332756-08ea-4f0b-b361-c8fdbf28d46d tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:50.814282 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-42332756-08ea-4f0b-b361-c8fdbf28d46d tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1522 microversion: 2.1 time: 0.242311 Apr 15 19:55:50.814907 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 286/535] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:50 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:55:50.819834 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d2b97d36-88a1-44da-83ab-35a25dcd19ef tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:50.820857 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d2b97d36-88a1-44da-83ab-35a25dcd19ef tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:50.829760 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d2b97d36-88a1-44da-83ab-35a25dcd19ef tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:50.830273 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d2b97d36-88a1-44da-83ab-35a25dcd19ef tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:50.831128 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d2b97d36-88a1-44da-83ab-35a25dcd19ef tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:50.831708 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d2b97d36-88a1-44da-83ab-35a25dcd19ef tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:50.949430 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d2b97d36-88a1-44da-83ab-35a25dcd19ef tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28667 microversion: 2.1 time: 0.133080 Apr 15 19:55:50.950132 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 287/536] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:50 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28667 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:55:51.390573 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a6e7f134-ee7d-4128-ad0b-7f08111c4e78 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:51.391358 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a6e7f134-ee7d-4128-ad0b-7f08111c4e78 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:51.399797 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a6e7f134-ee7d-4128-ad0b-7f08111c4e78 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:51.400304 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a6e7f134-ee7d-4128-ad0b-7f08111c4e78 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:51.401131 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a6e7f134-ee7d-4128-ad0b-7f08111c4e78 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:51.401621 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a6e7f134-ee7d-4128-ad0b-7f08111c4e78 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:51.624990 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a6e7f134-ee7d-4128-ad0b-7f08111c4e78 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:51.634798 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a6e7f134-ee7d-4128-ad0b-7f08111c4e78 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:51.636544 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a6e7f134-ee7d-4128-ad0b-7f08111c4e78 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:51.637777 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a6e7f134-ee7d-4128-ad0b-7f08111c4e78 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1746 microversion: 2.20 time: 0.251842 Apr 15 19:55:51.638389 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 288/537] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:55:51 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1746 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 19:55:51.834003 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ee105704-8e9e-4f2b-b7ca-27721a032d2f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:51.834681 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ee105704-8e9e-4f2b-b7ca-27721a032d2f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:51.844278 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ee105704-8e9e-4f2b-b7ca-27721a032d2f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:51.844793 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ee105704-8e9e-4f2b-b7ca-27721a032d2f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:51.845663 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ee105704-8e9e-4f2b-b7ca-27721a032d2f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:51.846162 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ee105704-8e9e-4f2b-b7ca-27721a032d2f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:52.292285 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ee105704-8e9e-4f2b-b7ca-27721a032d2f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:52.311947 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ee105704-8e9e-4f2b-b7ca-27721a032d2f tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1522 microversion: 2.1 time: 0.471650 Apr 15 19:55:52.311947 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 289/538] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:51 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1522 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:55:52.311947 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b4774bb8-0713-4b0f-b869-4f6197c428cb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:52.311947 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b4774bb8-0713-4b0f-b869-4f6197c428cb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:52.317061 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b4774bb8-0713-4b0f-b869-4f6197c428cb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:52.317571 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b4774bb8-0713-4b0f-b869-4f6197c428cb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:52.318574 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b4774bb8-0713-4b0f-b869-4f6197c428cb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:52.319065 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b4774bb8-0713-4b0f-b869-4f6197c428cb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:52.451847 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b4774bb8-0713-4b0f-b869-4f6197c428cb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 28667 microversion: 2.1 time: 0.148369 Apr 15 19:55:52.453504 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 290/539] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:52 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 28667 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:55:52.659638 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a14cf687-9651-43e2-8013-aaf050013379 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:52.660572 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a14cf687-9651-43e2-8013-aaf050013379 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:52.670948 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a14cf687-9651-43e2-8013-aaf050013379 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:52.671680 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a14cf687-9651-43e2-8013-aaf050013379 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:52.672608 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a14cf687-9651-43e2-8013-aaf050013379 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:52.673170 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a14cf687-9651-43e2-8013-aaf050013379 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:53.064341 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a14cf687-9651-43e2-8013-aaf050013379 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:53.074588 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a14cf687-9651-43e2-8013-aaf050013379 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:53.076378 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a14cf687-9651-43e2-8013-aaf050013379 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:53.078217 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a14cf687-9651-43e2-8013-aaf050013379 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1746 microversion: 2.20 time: 0.424040 Apr 15 19:55:53.078837 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 291/540] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:55:52 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1746 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 19:55:53.084321 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-24a69dc6-d58a-46f9-8a7e-40667cf74153 req-557f0387-454f-4b14-8302-feb93a7c3d63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f202f3f-01c9-41c6-842e-ee96f6b40094", "name": "network-vif-deleted", "tag": "8cba2f2f-513f-4df4-9b61-66010fa48a36"}]} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:53.086045 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:55:53.086045 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:55:53.095649 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-24a69dc6-d58a-46f9-8a7e-40667cf74153 req-557f0387-454f-4b14-8302-feb93a7c3d63 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:53.096063 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-24a69dc6-d58a-46f9-8a7e-40667cf74153 req-557f0387-454f-4b14-8302-feb93a7c3d63 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:53.114537 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-24a69dc6-d58a-46f9-8a7e-40667cf74153 req-557f0387-454f-4b14-8302-feb93a7c3d63 service nova] Creating event network-vif-deleted:8cba2f2f-513f-4df4-9b61-66010fa48a36 for instance 4f202f3f-01c9-41c6-842e-ee96f6b40094 on hv-cinder-78638 Apr 15 19:55:53.119539 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-24a69dc6-d58a-46f9-8a7e-40667cf74153 req-557f0387-454f-4b14-8302-feb93a7c3d63 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039371 Apr 15 19:55:53.120198 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 292/541] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:55:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:55:53.322633 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-cc2a7aa5-0d95-48dc-8d02-482b1cabbacc tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:53.323583 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-cc2a7aa5-0d95-48dc-8d02-482b1cabbacc tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:53.333030 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cc2a7aa5-0d95-48dc-8d02-482b1cabbacc tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:53.333569 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cc2a7aa5-0d95-48dc-8d02-482b1cabbacc tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:53.334635 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cc2a7aa5-0d95-48dc-8d02-482b1cabbacc tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:53.335138 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cc2a7aa5-0d95-48dc-8d02-482b1cabbacc tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:53.409551 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cc2a7aa5-0d95-48dc-8d02-482b1cabbacc tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:53.410060 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cc2a7aa5-0d95-48dc-8d02-482b1cabbacc tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:53.410564 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.objects.instance [None req-cc2a7aa5-0d95-48dc-8d02-482b1cabbacc tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lazy-loading 'fault' on Instance uuid 4f202f3f-01c9-41c6-842e-ee96f6b40094 {{(pid=99511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 15 19:55:53.493737 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-cc2a7aa5-0d95-48dc-8d02-482b1cabbacc tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '803b65bf7cb54fffab5ad634e9a1baea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684b341c4ce449dd86d6a51e0633e5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:53.503348 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-cc2a7aa5-0d95-48dc-8d02-482b1cabbacc tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 200 len: 1312 microversion: 2.1 time: 0.186703 Apr 15 19:55:53.503975 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 293/542] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:53 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 1312 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:55:53.508759 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-05c44510-8b62-4f02-b411-5d592b331f09 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:53.509791 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-05c44510-8b62-4f02-b411-5d592b331f09 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:53.518485 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-05c44510-8b62-4f02-b411-5d592b331f09 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:53.519001 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-05c44510-8b62-4f02-b411-5d592b331f09 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:53.520352 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-05c44510-8b62-4f02-b411-5d592b331f09 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:53.520921 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-05c44510-8b62-4f02-b411-5d592b331f09 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:53.630523 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-05c44510-8b62-4f02-b411-5d592b331f09 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 29047 microversion: 2.1 time: 0.125150 Apr 15 19:55:53.631566 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 294/543] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:53 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 29047 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:55:54.099127 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-5232f680-e836-4036-b2cf-44aae50bb655 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:54.099928 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-5232f680-e836-4036-b2cf-44aae50bb655 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:54.109213 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5232f680-e836-4036-b2cf-44aae50bb655 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:54.109716 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5232f680-e836-4036-b2cf-44aae50bb655 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:54.110554 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5232f680-e836-4036-b2cf-44aae50bb655 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:54.111046 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5232f680-e836-4036-b2cf-44aae50bb655 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:54.331487 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-5232f680-e836-4036-b2cf-44aae50bb655 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:54.341718 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-5232f680-e836-4036-b2cf-44aae50bb655 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:54.343914 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-5232f680-e836-4036-b2cf-44aae50bb655 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:54.345176 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-5232f680-e836-4036-b2cf-44aae50bb655 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1741 microversion: 2.20 time: 0.251123 Apr 15 19:55:54.345817 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 295/544] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:55:54 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1741 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 19:55:54.520961 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c05ec3f4-7d0e-4ce1-819c-eb151dbaa272 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:54.521629 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c05ec3f4-7d0e-4ce1-819c-eb151dbaa272 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] [instance: 4f202f3f-01c9-41c6-842e-ee96f6b40094] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:54.530000 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c05ec3f4-7d0e-4ce1-819c-eb151dbaa272 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:54.530455 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c05ec3f4-7d0e-4ce1-819c-eb151dbaa272 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:54.531298 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c05ec3f4-7d0e-4ce1-819c-eb151dbaa272 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:54.531791 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c05ec3f4-7d0e-4ce1-819c-eb151dbaa272 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:54.587101 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-c05ec3f4-7d0e-4ce1-819c-eb151dbaa272 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] HTTP exception thrown: Instance 4f202f3f-01c9-41c6-842e-ee96f6b40094 could not be found. Apr 15 19:55:54.587794 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c05ec3f4-7d0e-4ce1-819c-eb151dbaa272 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] Returning 404 to user: Instance 4f202f3f-01c9-41c6-842e-ee96f6b40094 could not be found. {{(pid=99511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 19:55:54.588685 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c05ec3f4-7d0e-4ce1-819c-eb151dbaa272 tempest-ServerRescueNegativeTestJSON-1968441602 tempest-ServerRescueNegativeTestJSON-1968441602-project] 10.222.0.58 "GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094" status: 404 len: 111 microversion: 2.1 time: 0.071753 Apr 15 19:55:54.589295 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 296/545] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:54 2021] GET /compute/v2.1/servers/4f202f3f-01c9-41c6-842e-ee96f6b40094 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 15 19:55:54.643637 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-2d05e1e2-19e5-4c6d-b50c-822e5e82b77b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:54.644917 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-2d05e1e2-19e5-4c6d-b50c-822e5e82b77b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:54.653069 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2d05e1e2-19e5-4c6d-b50c-822e5e82b77b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:54.653579 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2d05e1e2-19e5-4c6d-b50c-822e5e82b77b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:54.654418 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2d05e1e2-19e5-4c6d-b50c-822e5e82b77b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:54.655533 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2d05e1e2-19e5-4c6d-b50c-822e5e82b77b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:54.769326 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-2d05e1e2-19e5-4c6d-b50c-822e5e82b77b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 30668 microversion: 2.1 time: 0.130127 Apr 15 19:55:54.773712 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 297/546] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:54 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 30668 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:55:54.909950 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.network.neutron [None req-ffd2c301-04ef-4088-b9f5-be3042c45d22 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] validate_networks() for [('d2e11d43-a253-422d-a44e-09304a48dfbf', None, None, None)] {{(pid=99512) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 15 19:55:55.366611 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b22eea21-b08a-4db9-9aa5-6ea0e08f6c5d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:55.367303 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b22eea21-b08a-4db9-9aa5-6ea0e08f6c5d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:55.379333 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b22eea21-b08a-4db9-9aa5-6ea0e08f6c5d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:55.379872 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b22eea21-b08a-4db9-9aa5-6ea0e08f6c5d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:55.380731 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b22eea21-b08a-4db9-9aa5-6ea0e08f6c5d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:55.381226 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b22eea21-b08a-4db9-9aa5-6ea0e08f6c5d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:55.674397 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-ffd2c301-04ef-4088-b9f5-be3042c45d22 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Flavor limits 0:0:0 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 15 19:55:55.674945 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-ffd2c301-04ef-4088-b9f5-be3042c45d22 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Image limits 0:0:0 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 15 19:55:55.675606 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-ffd2c301-04ef-4088-b9f5-be3042c45d22 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Flavor pref 0:0:0 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 15 19:55:55.676161 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-ffd2c301-04ef-4088-b9f5-be3042c45d22 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Image pref 0:0:0 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 15 19:55:55.676701 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-ffd2c301-04ef-4088-b9f5-be3042c45d22 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 15 19:55:55.702796 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ffd2c301-04ef-4088-b9f5-be3042c45d22 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:55.714766 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ffd2c301-04ef-4088-b9f5-be3042c45d22 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:55.715783 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ffd2c301-04ef-4088-b9f5-be3042c45d22 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:55.716283 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ffd2c301-04ef-4088-b9f5-be3042c45d22 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:55.750704 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b22eea21-b08a-4db9-9aa5-6ea0e08f6c5d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:55.773857 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b22eea21-b08a-4db9-9aa5-6ea0e08f6c5d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:55.779075 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b22eea21-b08a-4db9-9aa5-6ea0e08f6c5d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:55.782768 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-ffd2c301-04ef-4088-b9f5-be3042c45d22 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Getting quotas for project c4982826645345ceb30d47046d10f317. Resources: {'cores', 'instances', 'ram'} {{(pid=99512) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 15 19:55:55.783136 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b22eea21-b08a-4db9-9aa5-6ea0e08f6c5d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1741 microversion: 2.20 time: 0.419780 Apr 15 19:55:55.784050 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 298/547] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:55:55 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1741 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 19:55:55.791823 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c2f1f41e-3184-4462-b703-be39dc076798 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:55.794256 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-ffd2c301-04ef-4088-b9f5-be3042c45d22 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Getting quotas for user 14fc42f165ba4963903dc11f69ab6ab5 and project c4982826645345ceb30d47046d10f317. Resources: {'cores', 'instances', 'ram'} {{(pid=99512) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 15 19:55:55.798108 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c2f1f41e-3184-4462-b703-be39dc076798 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:55.815837 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c2f1f41e-3184-4462-b703-be39dc076798 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:55.817549 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ffd2c301-04ef-4088-b9f5-be3042c45d22 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Going to run 1 instances... {{(pid=99512) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 15 19:55:55.818016 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c2f1f41e-3184-4462-b703-be39dc076798 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:55.820710 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ffd2c301-04ef-4088-b9f5-be3042c45d22 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8ab90366-da9b-4255-a335-f1c43da0bd11',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 15 19:55:55.821738 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c2f1f41e-3184-4462-b703-be39dc076798 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:55.822311 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c2f1f41e-3184-4462-b703-be39dc076798 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:55.914938 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ffd2c301-04ef-4088-b9f5-be3042c45d22 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 14.811141 Apr 15 19:55:55.921130 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 250/548] 10.222.0.58 () {60 vars in 1137 bytes} [Thu Apr 15 19:55:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 14813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 15 19:55:55.927687 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f958b42c-46ae-4465-8103-4dd3f9142be1 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:55.928392 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f958b42c-46ae-4465-8103-4dd3f9142be1 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:55.960024 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c2f1f41e-3184-4462-b703-be39dc076798 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 32135 microversion: 2.1 time: 0.174034 Apr 15 19:55:55.961324 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 299/549] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:55 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 32135 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:55:56.028620 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f958b42c-46ae-4465-8103-4dd3f9142be1 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:56.039634 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f958b42c-46ae-4465-8103-4dd3f9142be1 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1257 microversion: 2.1 time: 0.116581 Apr 15 19:55:56.050190 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 251/550] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:55 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1257 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:55:56.803572 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6c0b05ae-5302-4046-851c-d2fbd98c06f1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:56.804968 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6c0b05ae-5302-4046-851c-d2fbd98c06f1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:56.819208 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6c0b05ae-5302-4046-851c-d2fbd98c06f1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:56.827062 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6c0b05ae-5302-4046-851c-d2fbd98c06f1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:56.828333 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6c0b05ae-5302-4046-851c-d2fbd98c06f1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:56.829669 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6c0b05ae-5302-4046-851c-d2fbd98c06f1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:56.972737 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-36493703-dfc7-4ca5-b2a0-763d33faf3a3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:56.973897 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-36493703-dfc7-4ca5-b2a0-763d33faf3a3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:56.996511 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-36493703-dfc7-4ca5-b2a0-763d33faf3a3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:56.997215 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-36493703-dfc7-4ca5-b2a0-763d33faf3a3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:56.998305 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-36493703-dfc7-4ca5-b2a0-763d33faf3a3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:56.999467 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-36493703-dfc7-4ca5-b2a0-763d33faf3a3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:57.142540 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-36493703-dfc7-4ca5-b2a0-763d33faf3a3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 33253 microversion: 2.1 time: 0.173172 Apr 15 19:55:57.147427 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 252/551] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:56 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 33253 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:55:57.153427 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c55829a5-597c-4dc5-bc19-c668dd0738ef tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:57.158321 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c55829a5-597c-4dc5-bc19-c668dd0738ef tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:57.179764 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c55829a5-597c-4dc5-bc19-c668dd0738ef tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:57.180789 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c55829a5-597c-4dc5-bc19-c668dd0738ef tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:57.182413 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c55829a5-597c-4dc5-bc19-c668dd0738ef tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:57.182919 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c55829a5-597c-4dc5-bc19-c668dd0738ef tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:57.604474 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c55829a5-597c-4dc5-bc19-c668dd0738ef tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:57.619181 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-6c0b05ae-5302-4046-851c-d2fbd98c06f1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:57.625279 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c55829a5-597c-4dc5-bc19-c668dd0738ef tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1309 microversion: 2.1 time: 0.476160 Apr 15 19:55:57.626345 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 253/552] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:57 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1309 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:55:57.642108 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-6c0b05ae-5302-4046-851c-d2fbd98c06f1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:57.643946 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-6c0b05ae-5302-4046-851c-d2fbd98c06f1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:57.645389 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6c0b05ae-5302-4046-851c-d2fbd98c06f1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1741 microversion: 2.20 time: 0.846840 Apr 15 19:55:57.646394 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 300/553] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:55:56 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1741 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:55:58.157606 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-45d1c32a-402a-4b6d-8c1f-49e7a7b74c2c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:58.159398 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-45d1c32a-402a-4b6d-8c1f-49e7a7b74c2c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:58.174119 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-45d1c32a-402a-4b6d-8c1f-49e7a7b74c2c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:58.174869 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-45d1c32a-402a-4b6d-8c1f-49e7a7b74c2c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:58.176778 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-45d1c32a-402a-4b6d-8c1f-49e7a7b74c2c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:58.177554 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-45d1c32a-402a-4b6d-8c1f-49e7a7b74c2c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:58.309757 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-45d1c32a-402a-4b6d-8c1f-49e7a7b74c2c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 33807 microversion: 2.1 time: 0.157568 Apr 15 19:55:58.311911 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 254/554] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:58 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 33807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:55:58.644848 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-901a7c02-c057-4dcd-9725-a3c3fd27dadf tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:58.645662 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-901a7c02-c057-4dcd-9725-a3c3fd27dadf tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:58.665628 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-1985682f-4b9a-4fea-a251-96752fae9a44 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:55:58.666575 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-1985682f-4b9a-4fea-a251-96752fae9a44 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:58.674326 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-901a7c02-c057-4dcd-9725-a3c3fd27dadf tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:58.674837 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-901a7c02-c057-4dcd-9725-a3c3fd27dadf tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:58.675736 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-901a7c02-c057-4dcd-9725-a3c3fd27dadf tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:58.676234 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-901a7c02-c057-4dcd-9725-a3c3fd27dadf tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:58.685149 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1985682f-4b9a-4fea-a251-96752fae9a44 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:58.685700 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1985682f-4b9a-4fea-a251-96752fae9a44 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:58.686560 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1985682f-4b9a-4fea-a251-96752fae9a44 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:58.687056 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1985682f-4b9a-4fea-a251-96752fae9a44 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:59.152252 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-901a7c02-c057-4dcd-9725-a3c3fd27dadf tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:59.168693 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-901a7c02-c057-4dcd-9725-a3c3fd27dadf tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1315 microversion: 2.1 time: 0.528340 Apr 15 19:55:59.169330 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 301/555] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:55:58 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1315 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:55:59.185488 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-1985682f-4b9a-4fea-a251-96752fae9a44 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:59.210288 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-1985682f-4b9a-4fea-a251-96752fae9a44 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:59.212596 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-1985682f-4b9a-4fea-a251-96752fae9a44 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:55:59.213442 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-1985682f-4b9a-4fea-a251-96752fae9a44 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1741 microversion: 2.20 time: 0.552670 Apr 15 19:55:59.214353 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 255/556] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:55:58 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1741 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:55:59.323228 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-4ee39259-b6a0-4702-86ea-ca64dc50d34c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:55:59.324694 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-4ee39259-b6a0-4702-86ea-ca64dc50d34c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:55:59.341092 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4ee39259-b6a0-4702-86ea-ca64dc50d34c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:59.341665 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4ee39259-b6a0-4702-86ea-ca64dc50d34c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:55:59.343182 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4ee39259-b6a0-4702-86ea-ca64dc50d34c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:55:59.349075 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4ee39259-b6a0-4702-86ea-ca64dc50d34c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:00.187212 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-607a8e16-986b-46d9-993b-15249b499130 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:00.189326 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-607a8e16-986b-46d9-993b-15249b499130 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:00.209586 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-607a8e16-986b-46d9-993b-15249b499130 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:00.210425 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-607a8e16-986b-46d9-993b-15249b499130 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:00.211532 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-607a8e16-986b-46d9-993b-15249b499130 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:00.212206 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-607a8e16-986b-46d9-993b-15249b499130 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:00.865436 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-607a8e16-986b-46d9-993b-15249b499130 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:00.876057 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-4ee39259-b6a0-4702-86ea-ca64dc50d34c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 35912 microversion: 2.1 time: 1.556589 Apr 15 19:56:00.877441 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 302/557] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:55:59 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 35912 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:56:00.880087 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-607a8e16-986b-46d9-993b-15249b499130 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1357 microversion: 2.1 time: 0.697558 Apr 15 19:56:00.880723 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 256/558] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:00 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1357 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:00.883734 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ef6bd9e1-2bb0-4fc9-8c40-0b08503491c0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:00.884451 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ef6bd9e1-2bb0-4fc9-8c40-0b08503491c0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:00.912711 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ef6bd9e1-2bb0-4fc9-8c40-0b08503491c0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:00.920724 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ef6bd9e1-2bb0-4fc9-8c40-0b08503491c0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:00.924877 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ef6bd9e1-2bb0-4fc9-8c40-0b08503491c0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:00.925638 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ef6bd9e1-2bb0-4fc9-8c40-0b08503491c0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:01.900131 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-24cf733f-421e-4ebb-a103-01b325c8df51 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:56:01.901890 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-24cf733f-421e-4ebb-a103-01b325c8df51 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:01.919204 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-24cf733f-421e-4ebb-a103-01b325c8df51 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:01.919741 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-24cf733f-421e-4ebb-a103-01b325c8df51 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:01.920642 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-24cf733f-421e-4ebb-a103-01b325c8df51 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:01.921142 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-24cf733f-421e-4ebb-a103-01b325c8df51 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:01.971408 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ef6bd9e1-2bb0-4fc9-8c40-0b08503491c0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:01.985560 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ef6bd9e1-2bb0-4fc9-8c40-0b08503491c0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:01.987233 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ef6bd9e1-2bb0-4fc9-8c40-0b08503491c0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:01.992631 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ef6bd9e1-2bb0-4fc9-8c40-0b08503491c0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1741 microversion: 2.20 time: 1.113709 Apr 15 19:56:01.993448 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 303/559] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:00 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1741 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:56:02.000422 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a3b3d4ae-d880-4030-81cb-c08392353340 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:02.005083 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a3b3d4ae-d880-4030-81cb-c08392353340 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:02.031212 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a3b3d4ae-d880-4030-81cb-c08392353340 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:02.033237 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a3b3d4ae-d880-4030-81cb-c08392353340 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:02.034246 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a3b3d4ae-d880-4030-81cb-c08392353340 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:02.034786 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a3b3d4ae-d880-4030-81cb-c08392353340 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:02.228204 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-24cf733f-421e-4ebb-a103-01b325c8df51 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 37271 microversion: 2.1 time: 0.337709 Apr 15 19:56:02.229388 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 257/560] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:56:01 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 37271 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:56:02.636401 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a3b3d4ae-d880-4030-81cb-c08392353340 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:02.653078 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a3b3d4ae-d880-4030-81cb-c08392353340 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1357 microversion: 2.1 time: 0.658665 Apr 15 19:56:02.658630 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 304/561] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:01 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1357 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:03.013328 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-75d6aa1f-c388-45db-b95f-74af4fc3f787 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:03.015321 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-75d6aa1f-c388-45db-b95f-74af4fc3f787 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:03.036284 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-75d6aa1f-c388-45db-b95f-74af4fc3f787 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:03.044133 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-75d6aa1f-c388-45db-b95f-74af4fc3f787 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:03.045301 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-75d6aa1f-c388-45db-b95f-74af4fc3f787 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:03.047912 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-75d6aa1f-c388-45db-b95f-74af4fc3f787 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:03.241641 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-56832b44-a2d6-4b0f-af32-c2051fe40d3d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:56:03.242672 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-56832b44-a2d6-4b0f-af32-c2051fe40d3d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:03.257568 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-56832b44-a2d6-4b0f-af32-c2051fe40d3d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:03.258073 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-56832b44-a2d6-4b0f-af32-c2051fe40d3d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:03.258930 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-56832b44-a2d6-4b0f-af32-c2051fe40d3d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:03.270738 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-56832b44-a2d6-4b0f-af32-c2051fe40d3d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:03.502133 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-56832b44-a2d6-4b0f-af32-c2051fe40d3d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 38194 microversion: 2.1 time: 0.264399 Apr 15 19:56:03.506887 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 305/562] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:56:03 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 38194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:56:03.679739 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-4364e274-2021-456d-9030-e21ae463f6d6 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:03.680748 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-4364e274-2021-456d-9030-e21ae463f6d6 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:03.705685 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4364e274-2021-456d-9030-e21ae463f6d6 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:03.718539 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4364e274-2021-456d-9030-e21ae463f6d6 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:03.719478 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4364e274-2021-456d-9030-e21ae463f6d6 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:03.720034 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4364e274-2021-456d-9030-e21ae463f6d6 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:04.460768 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-75d6aa1f-c388-45db-b95f-74af4fc3f787 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:04.486707 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-75d6aa1f-c388-45db-b95f-74af4fc3f787 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:04.488764 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-75d6aa1f-c388-45db-b95f-74af4fc3f787 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:04.490236 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-75d6aa1f-c388-45db-b95f-74af4fc3f787 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1741 microversion: 2.20 time: 1.481543 Apr 15 19:56:04.504425 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 258/563] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:03 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1741 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:56:04.511853 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-315b5fc2-6119-4f80-9a41-b4ef894f5143 req-15af0e1a-03de-45ab-ad10-cef4c5c71900 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1ea7a7c-3e3e-47c5-8955-a3b27a52d453", "tag": "619a8492-f932-4048-8258-fe9757a50525"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:56:04.514398 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:56:04.514398 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:56:04.523957 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-315b5fc2-6119-4f80-9a41-b4ef894f5143 req-15af0e1a-03de-45ab-ad10-cef4c5c71900 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:04.524783 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-315b5fc2-6119-4f80-9a41-b4ef894f5143 req-15af0e1a-03de-45ab-ad10-cef4c5c71900 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:04.546560 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-315b5fc2-6119-4f80-9a41-b4ef894f5143 req-15af0e1a-03de-45ab-ad10-cef4c5c71900 service nova] Creating event network-changed:619a8492-f932-4048-8258-fe9757a50525 for instance b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 on hv-cinder-78638 Apr 15 19:56:04.552330 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-315b5fc2-6119-4f80-9a41-b4ef894f5143 req-15af0e1a-03de-45ab-ad10-cef4c5c71900 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046223 Apr 15 19:56:04.555189 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 259/564] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:56:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:56:04.563661 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-8b20c3b1-37c4-4436-bf79-e17084d142e7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:56:04.565076 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-8b20c3b1-37c4-4436-bf79-e17084d142e7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:04.574219 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8b20c3b1-37c4-4436-bf79-e17084d142e7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:04.575025 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8b20c3b1-37c4-4436-bf79-e17084d142e7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:04.576669 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8b20c3b1-37c4-4436-bf79-e17084d142e7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:04.577359 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8b20c3b1-37c4-4436-bf79-e17084d142e7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:04.962410 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-4364e274-2021-456d-9030-e21ae463f6d6 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:04.975050 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-4364e274-2021-456d-9030-e21ae463f6d6 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1357 microversion: 2.1 time: 1.300358 Apr 15 19:56:04.975662 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 306/565] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:03 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1357 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:05.510439 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9b49558a-69f4-40e0-842e-e7fe14105c3b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:05.511877 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9b49558a-69f4-40e0-842e-e7fe14105c3b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:05.523729 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9b49558a-69f4-40e0-842e-e7fe14105c3b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:05.524758 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9b49558a-69f4-40e0-842e-e7fe14105c3b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:05.525919 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9b49558a-69f4-40e0-842e-e7fe14105c3b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:05.526704 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9b49558a-69f4-40e0-842e-e7fe14105c3b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:05.881249 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9b49558a-69f4-40e0-842e-e7fe14105c3b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:05.893726 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9b49558a-69f4-40e0-842e-e7fe14105c3b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:05.895613 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9b49558a-69f4-40e0-842e-e7fe14105c3b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:05.896951 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9b49558a-69f4-40e0-842e-e7fe14105c3b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1741 microversion: 2.20 time: 0.391738 Apr 15 19:56:05.897668 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 307/566] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:05 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1741 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 19:56:05.999689 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-013f8ecc-004e-48a1-9552-3f96c78e9be7 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:06.000502 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-013f8ecc-004e-48a1-9552-3f96c78e9be7 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:06.069561 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-013f8ecc-004e-48a1-9552-3f96c78e9be7 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:06.073491 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-013f8ecc-004e-48a1-9552-3f96c78e9be7 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:06.080744 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-013f8ecc-004e-48a1-9552-3f96c78e9be7 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:06.081991 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-013f8ecc-004e-48a1-9552-3f96c78e9be7 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:06.886340 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-013f8ecc-004e-48a1-9552-3f96c78e9be7 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:06.897787 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-013f8ecc-004e-48a1-9552-3f96c78e9be7 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1357 microversion: 2.1 time: 0.903725 Apr 15 19:56:06.898735 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 308/567] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:05 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1357 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:06.926833 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-09f1ae7b-2f60-4b5f-9229-26a35797f045 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:06.927926 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-09f1ae7b-2f60-4b5f-9229-26a35797f045 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:06.938818 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-09f1ae7b-2f60-4b5f-9229-26a35797f045 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:06.939623 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-09f1ae7b-2f60-4b5f-9229-26a35797f045 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:06.940681 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-09f1ae7b-2f60-4b5f-9229-26a35797f045 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:06.941353 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-09f1ae7b-2f60-4b5f-9229-26a35797f045 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:07.703634 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-09f1ae7b-2f60-4b5f-9229-26a35797f045 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:07.727718 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-09f1ae7b-2f60-4b5f-9229-26a35797f045 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:07.729595 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-09f1ae7b-2f60-4b5f-9229-26a35797f045 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:07.737219 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-09f1ae7b-2f60-4b5f-9229-26a35797f045 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1741 microversion: 2.20 time: 0.822733 Apr 15 19:56:07.747815 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 309/568] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:06 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1741 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:56:07.923608 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-50d970ad-6f15-4f01-8c8d-f6e29ef43ac7 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:07.924263 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-50d970ad-6f15-4f01-8c8d-f6e29ef43ac7 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:07.942986 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-50d970ad-6f15-4f01-8c8d-f6e29ef43ac7 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:07.943558 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-50d970ad-6f15-4f01-8c8d-f6e29ef43ac7 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:07.944424 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-50d970ad-6f15-4f01-8c8d-f6e29ef43ac7 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:07.944921 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-50d970ad-6f15-4f01-8c8d-f6e29ef43ac7 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:08.247263 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-50d970ad-6f15-4f01-8c8d-f6e29ef43ac7 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:08.269542 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-50d970ad-6f15-4f01-8c8d-f6e29ef43ac7 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1357 microversion: 2.1 time: 0.350365 Apr 15 19:56:08.270792 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 310/569] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:07 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1357 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:08.763224 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f1445365-ed9b-491f-8704-3065e11bef35 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:08.765081 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f1445365-ed9b-491f-8704-3065e11bef35 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:08.778152 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f1445365-ed9b-491f-8704-3065e11bef35 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:08.780274 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f1445365-ed9b-491f-8704-3065e11bef35 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:08.781275 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f1445365-ed9b-491f-8704-3065e11bef35 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:08.783054 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f1445365-ed9b-491f-8704-3065e11bef35 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:09.098468 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f1445365-ed9b-491f-8704-3065e11bef35 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:09.111183 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f1445365-ed9b-491f-8704-3065e11bef35 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:09.113321 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f1445365-ed9b-491f-8704-3065e11bef35 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:09.114994 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f1445365-ed9b-491f-8704-3065e11bef35 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1741 microversion: 2.20 time: 0.355935 Apr 15 19:56:09.115890 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 311/570] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:08 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1741 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:56:09.288489 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a2aa70ae-25cd-4dfd-b125-9c817e6393db tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:09.289508 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a2aa70ae-25cd-4dfd-b125-9c817e6393db tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:09.298643 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a2aa70ae-25cd-4dfd-b125-9c817e6393db tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:09.299250 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a2aa70ae-25cd-4dfd-b125-9c817e6393db tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:09.300136 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a2aa70ae-25cd-4dfd-b125-9c817e6393db tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:09.300636 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a2aa70ae-25cd-4dfd-b125-9c817e6393db tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:09.536844 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a2aa70ae-25cd-4dfd-b125-9c817e6393db tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:09.547710 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a2aa70ae-25cd-4dfd-b125-9c817e6393db tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1357 microversion: 2.1 time: 0.262977 Apr 15 19:56:09.548585 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 312/571] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:09 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1357 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:10.135125 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-62703b8c-c2e6-4c9f-82b2-1cae2f0ca50a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:10.135812 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-62703b8c-c2e6-4c9f-82b2-1cae2f0ca50a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:10.144350 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-62703b8c-c2e6-4c9f-82b2-1cae2f0ca50a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:10.144870 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-62703b8c-c2e6-4c9f-82b2-1cae2f0ca50a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:10.145725 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-62703b8c-c2e6-4c9f-82b2-1cae2f0ca50a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:10.146230 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-62703b8c-c2e6-4c9f-82b2-1cae2f0ca50a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:10.366576 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-62703b8c-c2e6-4c9f-82b2-1cae2f0ca50a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:10.376291 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-62703b8c-c2e6-4c9f-82b2-1cae2f0ca50a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:10.377961 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-62703b8c-c2e6-4c9f-82b2-1cae2f0ca50a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:10.379190 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-62703b8c-c2e6-4c9f-82b2-1cae2f0ca50a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1741 microversion: 2.20 time: 0.248224 Apr 15 19:56:10.379825 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 313/572] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:10 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1741 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 19:56:10.566193 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-490f9e4d-6b1b-4077-aeda-a0f2a88fa670 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:10.566770 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-490f9e4d-6b1b-4077-aeda-a0f2a88fa670 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:10.574781 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-490f9e4d-6b1b-4077-aeda-a0f2a88fa670 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:10.575316 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-490f9e4d-6b1b-4077-aeda-a0f2a88fa670 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:10.576648 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-490f9e4d-6b1b-4077-aeda-a0f2a88fa670 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:10.577136 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-490f9e4d-6b1b-4077-aeda-a0f2a88fa670 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:10.799589 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-490f9e4d-6b1b-4077-aeda-a0f2a88fa670 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:10.808730 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-490f9e4d-6b1b-4077-aeda-a0f2a88fa670 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1357 microversion: 2.1 time: 0.246818 Apr 15 19:56:10.809561 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 314/573] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:10 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1357 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:56:11.398364 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c3c5a9f9-e804-4ad0-8b47-2a6da627ac63 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:11.399033 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c3c5a9f9-e804-4ad0-8b47-2a6da627ac63 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:11.407267 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c3c5a9f9-e804-4ad0-8b47-2a6da627ac63 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:11.407811 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c3c5a9f9-e804-4ad0-8b47-2a6da627ac63 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:11.408668 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c3c5a9f9-e804-4ad0-8b47-2a6da627ac63 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:11.409165 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c3c5a9f9-e804-4ad0-8b47-2a6da627ac63 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:11.630661 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c3c5a9f9-e804-4ad0-8b47-2a6da627ac63 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:11.640408 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c3c5a9f9-e804-4ad0-8b47-2a6da627ac63 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:11.642358 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c3c5a9f9-e804-4ad0-8b47-2a6da627ac63 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:11.643918 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c3c5a9f9-e804-4ad0-8b47-2a6da627ac63 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1741 microversion: 2.20 time: 0.249628 Apr 15 19:56:11.644560 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 315/574] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:11 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1741 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 19:56:11.828575 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-822f5e24-8b66-4755-b5e4-7fc53c0fe7fd tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:11.829233 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-822f5e24-8b66-4755-b5e4-7fc53c0fe7fd tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:11.837653 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-822f5e24-8b66-4755-b5e4-7fc53c0fe7fd tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:11.838167 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-822f5e24-8b66-4755-b5e4-7fc53c0fe7fd tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:11.839016 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-822f5e24-8b66-4755-b5e4-7fc53c0fe7fd tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:11.839542 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-822f5e24-8b66-4755-b5e4-7fc53c0fe7fd tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:12.062286 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-822f5e24-8b66-4755-b5e4-7fc53c0fe7fd tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:12.072490 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-822f5e24-8b66-4755-b5e4-7fc53c0fe7fd tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1357 microversion: 2.1 time: 0.248187 Apr 15 19:56:12.072737 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 316/575] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:11 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1357 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:56:12.283741 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-18b3f5f7-a2ab-4e52-a7ec-aaf2b86d4986 tempest-VolumesTestJSON-1226750128 tempest-VolumesTestJSON-1226750128-project] Calling method '.version_select at 0x7f18d8194488>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:12.384769 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-18b3f5f7-a2ab-4e52-a7ec-aaf2b86d4986 tempest-VolumesTestJSON-1226750128 tempest-VolumesTestJSON-1226750128-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/1601e1de-1af7-4adb-a09f-7d28c845e5e2" status: 200 len: 351 microversion: 2.1 time: 0.104972 Apr 15 19:56:12.385393 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 317/576] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Apr 15 19:56:12 2021] GET /compute/v2.1/os-volumes/1601e1de-1af7-4adb-a09f-7d28c845e5e2 => generated 351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:56:12.663184 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d1c11cb3-7905-4937-bf01-a88841edba8a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:12.664046 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d1c11cb3-7905-4937-bf01-a88841edba8a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:12.674975 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d1c11cb3-7905-4937-bf01-a88841edba8a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:12.675526 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d1c11cb3-7905-4937-bf01-a88841edba8a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:12.676383 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d1c11cb3-7905-4937-bf01-a88841edba8a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:12.676873 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d1c11cb3-7905-4937-bf01-a88841edba8a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:12.959107 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d1c11cb3-7905-4937-bf01-a88841edba8a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:12.969974 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d1c11cb3-7905-4937-bf01-a88841edba8a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:12.971679 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d1c11cb3-7905-4937-bf01-a88841edba8a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:12.972918 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d1c11cb3-7905-4937-bf01-a88841edba8a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1741 microversion: 2.20 time: 0.313820 Apr 15 19:56:12.973753 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 318/577] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:12 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1741 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 19:56:13.090363 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-95d7d4e5-d657-4d71-b241-e9ca8bfc3138 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:13.091029 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-95d7d4e5-d657-4d71-b241-e9ca8bfc3138 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:13.099482 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-95d7d4e5-d657-4d71-b241-e9ca8bfc3138 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:13.100002 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-95d7d4e5-d657-4d71-b241-e9ca8bfc3138 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:13.100838 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-95d7d4e5-d657-4d71-b241-e9ca8bfc3138 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:13.101329 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-95d7d4e5-d657-4d71-b241-e9ca8bfc3138 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:13.325593 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-95d7d4e5-d657-4d71-b241-e9ca8bfc3138 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:13.335625 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-95d7d4e5-d657-4d71-b241-e9ca8bfc3138 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1357 microversion: 2.1 time: 0.249438 Apr 15 19:56:13.336398 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 319/578] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:13 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1357 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:56:13.993182 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-daffb79b-797f-4481-bd85-ee512f2ecff5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:13.993829 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-daffb79b-797f-4481-bd85-ee512f2ecff5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:14.002198 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-daffb79b-797f-4481-bd85-ee512f2ecff5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:14.002704 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-daffb79b-797f-4481-bd85-ee512f2ecff5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:14.003561 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-daffb79b-797f-4481-bd85-ee512f2ecff5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:14.004051 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-daffb79b-797f-4481-bd85-ee512f2ecff5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:14.222149 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-daffb79b-797f-4481-bd85-ee512f2ecff5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:14.232644 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-daffb79b-797f-4481-bd85-ee512f2ecff5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:14.234326 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-daffb79b-797f-4481-bd85-ee512f2ecff5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:14.235612 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-daffb79b-797f-4481-bd85-ee512f2ecff5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1741 microversion: 2.20 time: 0.246763 Apr 15 19:56:14.236225 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 320/579] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:13 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1741 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 19:56:14.354315 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-bcc7d3c8-bebf-4b90-baab-1ecba4acdbae tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:14.354991 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-bcc7d3c8-bebf-4b90-baab-1ecba4acdbae tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:14.363589 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bcc7d3c8-bebf-4b90-baab-1ecba4acdbae tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:14.364103 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bcc7d3c8-bebf-4b90-baab-1ecba4acdbae tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:14.364942 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bcc7d3c8-bebf-4b90-baab-1ecba4acdbae tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:14.365438 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bcc7d3c8-bebf-4b90-baab-1ecba4acdbae tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:14.586746 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-bcc7d3c8-bebf-4b90-baab-1ecba4acdbae tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:14.596092 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-bcc7d3c8-bebf-4b90-baab-1ecba4acdbae tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1357 microversion: 2.1 time: 0.245888 Apr 15 19:56:14.596714 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 321/580] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:14 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1357 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:56:15.021047 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-64384c68-4f10-4c1d-9a23-54ca3fb26323 tempest-VolumesTestJSON-1226750128 tempest-VolumesTestJSON-1226750128-project] Calling method '.version_select at 0x7f18d375ebf8>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:15.117091 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-64384c68-4f10-4c1d-9a23-54ca3fb26323 tempest-VolumesTestJSON-1226750128 tempest-VolumesTestJSON-1226750128-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/40e2c515-a1b7-4c66-a16f-7f595177e456" status: 200 len: 351 microversion: 2.1 time: 0.099944 Apr 15 19:56:15.117882 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 322/581] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Apr 15 19:56:15 2021] GET /compute/v2.1/os-volumes/40e2c515-a1b7-4c66-a16f-7f595177e456 => generated 351 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 15 19:56:15.255021 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-bb895cd8-d038-4877-b033-8e270a64fef0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:15.255694 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-bb895cd8-d038-4877-b033-8e270a64fef0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:15.264203 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bb895cd8-d038-4877-b033-8e270a64fef0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:15.264717 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bb895cd8-d038-4877-b033-8e270a64fef0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:15.265557 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bb895cd8-d038-4877-b033-8e270a64fef0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:15.266053 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bb895cd8-d038-4877-b033-8e270a64fef0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:15.508582 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-bb895cd8-d038-4877-b033-8e270a64fef0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:15.521531 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-bb895cd8-d038-4877-b033-8e270a64fef0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:15.521989 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-bb895cd8-d038-4877-b033-8e270a64fef0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:15.523240 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-bb895cd8-d038-4877-b033-8e270a64fef0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1741 microversion: 2.20 time: 0.272452 Apr 15 19:56:15.524048 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 323/582] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:15 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1741 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:56:15.614536 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-79cd0336-1a35-4327-97e9-c92b92af4f42 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:15.615209 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-79cd0336-1a35-4327-97e9-c92b92af4f42 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:15.623600 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-79cd0336-1a35-4327-97e9-c92b92af4f42 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:15.624111 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-79cd0336-1a35-4327-97e9-c92b92af4f42 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:15.624947 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-79cd0336-1a35-4327-97e9-c92b92af4f42 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:15.625442 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-79cd0336-1a35-4327-97e9-c92b92af4f42 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:15.831207 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-79cd0336-1a35-4327-97e9-c92b92af4f42 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:15.840092 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-79cd0336-1a35-4327-97e9-c92b92af4f42 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1357 microversion: 2.1 time: 0.229654 Apr 15 19:56:15.840770 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 324/583] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:15 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1357 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:56:16.542403 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-5990b621-4b96-4d8c-8921-6172baf68327 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:16.543079 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-5990b621-4b96-4d8c-8921-6172baf68327 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:16.551001 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5990b621-4b96-4d8c-8921-6172baf68327 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:16.551566 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5990b621-4b96-4d8c-8921-6172baf68327 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:16.552403 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5990b621-4b96-4d8c-8921-6172baf68327 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:16.552895 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5990b621-4b96-4d8c-8921-6172baf68327 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:16.771135 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-5990b621-4b96-4d8c-8921-6172baf68327 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:16.780547 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-5990b621-4b96-4d8c-8921-6172baf68327 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:16.782207 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-5990b621-4b96-4d8c-8921-6172baf68327 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:16.783437 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-5990b621-4b96-4d8c-8921-6172baf68327 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1741 microversion: 2.20 time: 0.245385 Apr 15 19:56:16.784037 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 325/584] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:16 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1741 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:56:16.857401 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-285c8cf2-fb4f-416c-9e48-0770c43642f9 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:16.858054 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-285c8cf2-fb4f-416c-9e48-0770c43642f9 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:16.865496 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-285c8cf2-fb4f-416c-9e48-0770c43642f9 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:16.866002 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-285c8cf2-fb4f-416c-9e48-0770c43642f9 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:16.866825 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-285c8cf2-fb4f-416c-9e48-0770c43642f9 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:16.867330 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-285c8cf2-fb4f-416c-9e48-0770c43642f9 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:17.075734 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-285c8cf2-fb4f-416c-9e48-0770c43642f9 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:17.085406 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-285c8cf2-fb4f-416c-9e48-0770c43642f9 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1357 microversion: 2.1 time: 0.231629 Apr 15 19:56:17.086020 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 326/585] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:16 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1357 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:56:17.725789 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9e0d6a19-bb72-48e9-8fa3-ab0cf36bdebb tempest-VolumesTestJSON-1226750128 tempest-VolumesTestJSON-1226750128-project] Calling method '.version_select at 0x7f18d375ee18>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:17.823235 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9e0d6a19-bb72-48e9-8fa3-ab0cf36bdebb tempest-VolumesTestJSON-1226750128 tempest-VolumesTestJSON-1226750128-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/4a8992f7-cc55-4005-bc60-c4faf5a45bad" status: 200 len: 350 microversion: 2.1 time: 0.101314 Apr 15 19:56:17.823911 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 327/586] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Apr 15 19:56:17 2021] GET /compute/v2.1/os-volumes/4a8992f7-cc55-4005-bc60-c4faf5a45bad => generated 350 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:56:17.829224 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-3655acda-439a-4fc2-aca5-68216cfff882 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:17.829894 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-3655acda-439a-4fc2-aca5-68216cfff882 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:17.837855 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3655acda-439a-4fc2-aca5-68216cfff882 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:17.838371 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3655acda-439a-4fc2-aca5-68216cfff882 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:17.839209 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3655acda-439a-4fc2-aca5-68216cfff882 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:17.839736 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3655acda-439a-4fc2-aca5-68216cfff882 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:18.049711 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3655acda-439a-4fc2-aca5-68216cfff882 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:18.059077 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3655acda-439a-4fc2-aca5-68216cfff882 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:18.060793 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3655acda-439a-4fc2-aca5-68216cfff882 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:18.062020 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-3655acda-439a-4fc2-aca5-68216cfff882 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1741 microversion: 2.20 time: 0.237108 Apr 15 19:56:18.062632 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 328/587] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:17 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1741 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:56:18.067158 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-4263adae-1abc-44c5-afb4-a161f7ab9bca tempest-VolumesTestJSON-1226750128 tempest-VolumesTestJSON-1226750128-project] Calling method '.version_select at 0x7f18d375e840>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:18.153785 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-4263adae-1abc-44c5-afb4-a161f7ab9bca tempest-VolumesTestJSON-1226750128 tempest-VolumesTestJSON-1226750128-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.090033 Apr 15 19:56:18.155054 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 329/588] 10.222.0.58 () {58 vars in 1124 bytes} [Thu Apr 15 19:56:18 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:18.159848 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-3d4007c6-c76b-4ca0-bfca-6f1629af0ccf tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:18.160573 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-3d4007c6-c76b-4ca0-bfca-6f1629af0ccf tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:18.172078 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3d4007c6-c76b-4ca0-bfca-6f1629af0ccf tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:18.172595 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3d4007c6-c76b-4ca0-bfca-6f1629af0ccf tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:18.173444 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3d4007c6-c76b-4ca0-bfca-6f1629af0ccf tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:18.173941 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3d4007c6-c76b-4ca0-bfca-6f1629af0ccf tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:18.383984 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3d4007c6-c76b-4ca0-bfca-6f1629af0ccf tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:18.393292 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-3d4007c6-c76b-4ca0-bfca-6f1629af0ccf tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1357 microversion: 2.1 time: 0.237130 Apr 15 19:56:18.393911 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 330/589] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:18 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1357 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:18.398463 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-1b6bfe81-86bd-4a3d-bf3a-36110251b403 tempest-VolumesTestJSON-1226750128 tempest-VolumesTestJSON-1226750128-project] Calling method '.version_select at 0x7f18d8194510>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:18.485104 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-1b6bfe81-86bd-4a3d-bf3a-36110251b403 tempest-VolumesTestJSON-1226750128 tempest-VolumesTestJSON-1226750128-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.090068 Apr 15 19:56:18.485735 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 331/590] 10.222.0.58 () {58 vars in 1139 bytes} [Thu Apr 15 19:56:18 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:56:18.498368 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b367ef4b-608c-41ec-99b5-fd106b6aff54 tempest-VolumesTestJSON-1226750128 tempest-VolumesTestJSON-1226750128-project] Calling method '.version_select at 0x7f18d81802f0>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:18.586737 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b367ef4b-608c-41ec-99b5-fd106b6aff54 tempest-VolumesTestJSON-1226750128 tempest-VolumesTestJSON-1226750128-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.092471 Apr 15 19:56:18.587392 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 332/591] 10.222.0.58 () {58 vars in 1124 bytes} [Thu Apr 15 19:56:18 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:56:18.599102 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e07f05f1-b9cb-401d-a612-b75cb5012890 tempest-VolumesTestJSON-1226750128 tempest-VolumesTestJSON-1226750128-project] Calling method '.version_select at 0x7f18d375e950>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:18.687098 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e07f05f1-b9cb-401d-a612-b75cb5012890 tempest-VolumesTestJSON-1226750128 tempest-VolumesTestJSON-1226750128-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091522 Apr 15 19:56:18.687884 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 333/592] 10.222.0.58 () {58 vars in 1157 bytes} [Thu Apr 15 19:56:18 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 15 19:56:18.699677 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-3bc18573-b04b-49ea-9653-7ce00d361caa tempest-VolumesTestJSON-1226750128 tempest-VolumesTestJSON-1226750128-project] Calling method '.version_select at 0x7f18d375eae8>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:18.789032 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-3bc18573-b04b-49ea-9653-7ce00d361caa tempest-VolumesTestJSON-1226750128 tempest-VolumesTestJSON-1226750128-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.092978 Apr 15 19:56:18.789658 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 334/593] 10.222.0.58 () {58 vars in 1160 bytes} [Thu Apr 15 19:56:18 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 15 19:56:18.802625 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ffee7bb2-9c85-4151-9974-9640a1905216 tempest-VolumesTestJSON-1226750128 tempest-VolumesTestJSON-1226750128-project] Calling method '.version_select at 0x7f18d8194488>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:19.010407 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ffee7bb2-9c85-4151-9974-9640a1905216 tempest-VolumesTestJSON-1226750128 tempest-VolumesTestJSON-1226750128-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.211366 Apr 15 19:56:19.011026 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 335/594] 10.222.0.58 () {58 vars in 1145 bytes} [Thu Apr 15 19:56:18 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:56:19.022385 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-725f385c-6b70-4bfe-9c72-500f8b0baceb tempest-VolumesTestJSON-1226750128 tempest-VolumesTestJSON-1226750128-project] Calling method '.version_select at 0x7f18d3653d90>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:19.110298 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-725f385c-6b70-4bfe-9c72-500f8b0baceb tempest-VolumesTestJSON-1226750128 tempest-VolumesTestJSON-1226750128-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091388 Apr 15 19:56:19.110866 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 336/595] 10.222.0.58 () {58 vars in 1178 bytes} [Thu Apr 15 19:56:19 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 15 19:56:19.115690 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a69bbccf-16c4-4d11-8457-20130b77acd1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:19.116343 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a69bbccf-16c4-4d11-8457-20130b77acd1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:19.124260 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a69bbccf-16c4-4d11-8457-20130b77acd1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:19.124772 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a69bbccf-16c4-4d11-8457-20130b77acd1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:19.125603 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a69bbccf-16c4-4d11-8457-20130b77acd1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:19.126091 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a69bbccf-16c4-4d11-8457-20130b77acd1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:19.333148 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a69bbccf-16c4-4d11-8457-20130b77acd1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:19.343065 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a69bbccf-16c4-4d11-8457-20130b77acd1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:19.344752 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a69bbccf-16c4-4d11-8457-20130b77acd1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:19.345957 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a69bbccf-16c4-4d11-8457-20130b77acd1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1741 microversion: 2.20 time: 0.234046 Apr 15 19:56:19.346564 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 337/596] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:19 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1741 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:56:19.351051 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d816e1a8-836b-43d5-a1a9-3af68c5a5fbb tempest-VolumesTestJSON-1226750128 tempest-VolumesTestJSON-1226750128-project] Calling method '.version_select at 0x7f18d817dea0>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:19.435762 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d816e1a8-836b-43d5-a1a9-3af68c5a5fbb tempest-VolumesTestJSON-1226750128 tempest-VolumesTestJSON-1226750128-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.088037 Apr 15 19:56:19.436421 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 338/597] 10.222.0.58 () {58 vars in 1145 bytes} [Thu Apr 15 19:56:19 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:19.441129 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a7968543-d4c7-4e4a-b35f-2d6069662de3 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:19.441838 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a7968543-d4c7-4e4a-b35f-2d6069662de3 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:19.450516 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a7968543-d4c7-4e4a-b35f-2d6069662de3 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:19.451585 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a7968543-d4c7-4e4a-b35f-2d6069662de3 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:19.452389 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a7968543-d4c7-4e4a-b35f-2d6069662de3 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:19.452931 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a7968543-d4c7-4e4a-b35f-2d6069662de3 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:19.670003 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a7968543-d4c7-4e4a-b35f-2d6069662de3 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:19.678868 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a7968543-d4c7-4e4a-b35f-2d6069662de3 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1357 microversion: 2.1 time: 0.241411 Apr 15 19:56:19.679506 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 339/598] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:19 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1357 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:20.365251 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d6c65909-424e-4ed1-aede-4da28d35f0d2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:20.365924 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d6c65909-424e-4ed1-aede-4da28d35f0d2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:20.374443 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d6c65909-424e-4ed1-aede-4da28d35f0d2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:20.374955 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d6c65909-424e-4ed1-aede-4da28d35f0d2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:20.375820 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d6c65909-424e-4ed1-aede-4da28d35f0d2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:20.376318 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d6c65909-424e-4ed1-aede-4da28d35f0d2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:20.585012 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d6c65909-424e-4ed1-aede-4da28d35f0d2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:20.594359 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d6c65909-424e-4ed1-aede-4da28d35f0d2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:20.596069 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d6c65909-424e-4ed1-aede-4da28d35f0d2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:20.597287 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d6c65909-424e-4ed1-aede-4da28d35f0d2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1741 microversion: 2.20 time: 0.236123 Apr 15 19:56:20.597888 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 340/599] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:20 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1741 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 19:56:20.696756 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d9d8a724-6b2a-4d40-9d70-287a71e1a528 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:20.697434 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d9d8a724-6b2a-4d40-9d70-287a71e1a528 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:20.706107 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d9d8a724-6b2a-4d40-9d70-287a71e1a528 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:20.706622 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d9d8a724-6b2a-4d40-9d70-287a71e1a528 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:20.707500 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d9d8a724-6b2a-4d40-9d70-287a71e1a528 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:20.707996 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d9d8a724-6b2a-4d40-9d70-287a71e1a528 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:21.140980 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d9d8a724-6b2a-4d40-9d70-287a71e1a528 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:21.149729 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d9d8a724-6b2a-4d40-9d70-287a71e1a528 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1357 microversion: 2.1 time: 0.456968 Apr 15 19:56:21.150343 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 341/600] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:20 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1357 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:56:21.616375 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-12af876f-181b-4103-8844-fd9e5e4e8a3a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:21.617045 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-12af876f-181b-4103-8844-fd9e5e4e8a3a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:21.624891 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-12af876f-181b-4103-8844-fd9e5e4e8a3a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:21.625402 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-12af876f-181b-4103-8844-fd9e5e4e8a3a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:21.626239 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-12af876f-181b-4103-8844-fd9e5e4e8a3a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:21.626735 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-12af876f-181b-4103-8844-fd9e5e4e8a3a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:21.838442 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-12af876f-181b-4103-8844-fd9e5e4e8a3a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:21.848457 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-12af876f-181b-4103-8844-fd9e5e4e8a3a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:21.850137 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-12af876f-181b-4103-8844-fd9e5e4e8a3a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:21.851381 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-12af876f-181b-4103-8844-fd9e5e4e8a3a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1741 microversion: 2.20 time: 0.239118 Apr 15 19:56:21.851994 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 342/601] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:21 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1741 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 19:56:22.167954 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9e2bdf94-3a97-434a-8b61-609b4ec863bb tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:22.168632 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9e2bdf94-3a97-434a-8b61-609b4ec863bb tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:22.177223 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9e2bdf94-3a97-434a-8b61-609b4ec863bb tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:22.177735 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9e2bdf94-3a97-434a-8b61-609b4ec863bb tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:22.178581 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9e2bdf94-3a97-434a-8b61-609b4ec863bb tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:22.179074 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9e2bdf94-3a97-434a-8b61-609b4ec863bb tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:22.391631 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9e2bdf94-3a97-434a-8b61-609b4ec863bb tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:22.400423 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9e2bdf94-3a97-434a-8b61-609b4ec863bb tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1357 microversion: 2.1 time: 0.236889 Apr 15 19:56:22.401035 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 343/602] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:22 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1357 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:56:22.870333 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-0efceb4a-46c9-4858-bc78-51e7a03d4808 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:22.871007 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-0efceb4a-46c9-4858-bc78-51e7a03d4808 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:22.879024 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0efceb4a-46c9-4858-bc78-51e7a03d4808 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:22.879626 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0efceb4a-46c9-4858-bc78-51e7a03d4808 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:22.880469 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0efceb4a-46c9-4858-bc78-51e7a03d4808 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:22.880963 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0efceb4a-46c9-4858-bc78-51e7a03d4808 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:23.091900 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-0efceb4a-46c9-4858-bc78-51e7a03d4808 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:23.101374 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-0efceb4a-46c9-4858-bc78-51e7a03d4808 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:23.103051 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-0efceb4a-46c9-4858-bc78-51e7a03d4808 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:23.104307 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-0efceb4a-46c9-4858-bc78-51e7a03d4808 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1741 microversion: 2.20 time: 0.238128 Apr 15 19:56:23.104924 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 344/603] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:22 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1741 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 19:56:23.418450 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-4a7d0db6-2a78-4b0a-9263-5861949e0c78 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:23.419224 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-4a7d0db6-2a78-4b0a-9263-5861949e0c78 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:23.427211 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4a7d0db6-2a78-4b0a-9263-5861949e0c78 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:23.427749 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4a7d0db6-2a78-4b0a-9263-5861949e0c78 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:23.428588 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4a7d0db6-2a78-4b0a-9263-5861949e0c78 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:23.429077 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4a7d0db6-2a78-4b0a-9263-5861949e0c78 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:23.645344 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-4a7d0db6-2a78-4b0a-9263-5861949e0c78 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:23.654893 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-4a7d0db6-2a78-4b0a-9263-5861949e0c78 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1357 microversion: 2.1 time: 0.240619 Apr 15 19:56:23.655573 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 345/604] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:23 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1357 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:56:23.892995 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-8b20c3b1-37c4-4436-bf79-e17084d142e7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 200 len: 38323 microversion: 2.1 time: 19.333538 Apr 15 19:56:23.894282 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 260/605] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:56:04 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 38323 bytes in 19336 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:56:23.906422 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-030d7828-7ff2-49b5-985d-c9cca73917d0 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:23.907132 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-030d7828-7ff2-49b5-985d-c9cca73917d0 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:23.944828 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-030d7828-7ff2-49b5-985d-c9cca73917d0 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:23.946163 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-030d7828-7ff2-49b5-985d-c9cca73917d0 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:23.949382 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-030d7828-7ff2-49b5-985d-c9cca73917d0 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:23.950244 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-030d7828-7ff2-49b5-985d-c9cca73917d0 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:24.015325 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-030d7828-7ff2-49b5-985d-c9cca73917d0 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/ips" status: 200 len: 144 microversion: 2.1 time: 0.114391 Apr 15 19:56:24.016427 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 346/606] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Apr 15 19:56:23 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/ips => generated 144 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:56:24.125114 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9d3ae576-fe32-4ef7-9386-62a96f7cedb8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:24.125978 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9d3ae576-fe32-4ef7-9386-62a96f7cedb8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:24.134961 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9d3ae576-fe32-4ef7-9386-62a96f7cedb8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:24.135506 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9d3ae576-fe32-4ef7-9386-62a96f7cedb8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:24.136350 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9d3ae576-fe32-4ef7-9386-62a96f7cedb8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:24.136850 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9d3ae576-fe32-4ef7-9386-62a96f7cedb8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:24.375152 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9d3ae576-fe32-4ef7-9386-62a96f7cedb8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:24.385314 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9d3ae576-fe32-4ef7-9386-62a96f7cedb8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:24.386983 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9d3ae576-fe32-4ef7-9386-62a96f7cedb8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:24.397473 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9d3ae576-fe32-4ef7-9386-62a96f7cedb8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1741 microversion: 2.20 time: 0.277568 Apr 15 19:56:24.398094 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 261/607] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:24 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1741 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:56:24.672976 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-170e17a9-782b-40fe-aa41-c6bec478cf2b tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:24.674232 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-170e17a9-782b-40fe-aa41-c6bec478cf2b tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:24.682600 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-170e17a9-782b-40fe-aa41-c6bec478cf2b tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:24.683696 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-170e17a9-782b-40fe-aa41-c6bec478cf2b tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:24.684722 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-170e17a9-782b-40fe-aa41-c6bec478cf2b tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:24.685613 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-170e17a9-782b-40fe-aa41-c6bec478cf2b tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:24.921652 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-170e17a9-782b-40fe-aa41-c6bec478cf2b tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:24.931318 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-170e17a9-782b-40fe-aa41-c6bec478cf2b tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1357 microversion: 2.1 time: 0.262187 Apr 15 19:56:24.932158 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 347/608] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:24 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1357 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:25.418162 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-92856235-713b-40e3-9f15-4ff049122539 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:25.420360 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-92856235-713b-40e3-9f15-4ff049122539 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:25.431448 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-92856235-713b-40e3-9f15-4ff049122539 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:25.432274 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-92856235-713b-40e3-9f15-4ff049122539 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:25.433518 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-92856235-713b-40e3-9f15-4ff049122539 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:25.434238 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-92856235-713b-40e3-9f15-4ff049122539 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:25.679901 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-92856235-713b-40e3-9f15-4ff049122539 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:25.690289 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-92856235-713b-40e3-9f15-4ff049122539 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:25.692161 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-92856235-713b-40e3-9f15-4ff049122539 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:25.693380 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-92856235-713b-40e3-9f15-4ff049122539 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1723 microversion: 2.20 time: 0.280087 Apr 15 19:56:25.693976 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 262/609] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:25 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1723 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:56:25.949816 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-643adeb1-75aa-4140-9d62-16e5da5f50b4 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:25.950401 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-643adeb1-75aa-4140-9d62-16e5da5f50b4 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:25.958846 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-643adeb1-75aa-4140-9d62-16e5da5f50b4 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:25.959566 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-643adeb1-75aa-4140-9d62-16e5da5f50b4 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:25.960508 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-643adeb1-75aa-4140-9d62-16e5da5f50b4 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:25.961003 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-643adeb1-75aa-4140-9d62-16e5da5f50b4 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:26.190433 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-643adeb1-75aa-4140-9d62-16e5da5f50b4 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:26.201972 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-643adeb1-75aa-4140-9d62-16e5da5f50b4 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1357 microversion: 2.1 time: 0.256096 Apr 15 19:56:26.202562 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 348/610] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:25 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1357 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:26.470148 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-bc4481e8-e938-4a2b-a0bc-0eaa92f1e7e1 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1694418576", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2030024038", "security_groups": [{"name": "tempest-secgroup-smoke-1835560356"}], "networks": [{"uuid": "25f49285-2bdf-40a5-b223-572153ecaf73"}], "block_device_mapping_v2": [{"uuid": "eb12e164-9ec4-47c2-a915-02b1906e9931", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:56:26.664738 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.network.neutron [None req-bc4481e8-e938-4a2b-a0bc-0eaa92f1e7e1 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] validate_networks() for [('25f49285-2bdf-40a5-b223-572153ecaf73', None, None, None)] {{(pid=99512) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 15 19:56:26.713559 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-cfbbc24f-6cef-4726-bcd8-86d045832e75 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:26.714393 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-cfbbc24f-6cef-4726-bcd8-86d045832e75 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:26.723141 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cfbbc24f-6cef-4726-bcd8-86d045832e75 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:26.723961 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cfbbc24f-6cef-4726-bcd8-86d045832e75 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:26.725032 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cfbbc24f-6cef-4726-bcd8-86d045832e75 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:26.725767 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cfbbc24f-6cef-4726-bcd8-86d045832e75 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:27.053822 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-cfbbc24f-6cef-4726-bcd8-86d045832e75 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:27.067313 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-cfbbc24f-6cef-4726-bcd8-86d045832e75 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:27.069979 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-cfbbc24f-6cef-4726-bcd8-86d045832e75 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:27.071357 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-cfbbc24f-6cef-4726-bcd8-86d045832e75 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1723 microversion: 2.20 time: 0.361957 Apr 15 19:56:27.072029 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 349/611] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:26 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1723 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:56:27.221091 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c2f85ebe-70e5-43ad-9581-1b64383ad0be tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:27.221817 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c2f85ebe-70e5-43ad-9581-1b64383ad0be tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:27.230125 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c2f85ebe-70e5-43ad-9581-1b64383ad0be tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:27.230606 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c2f85ebe-70e5-43ad-9581-1b64383ad0be tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:27.231469 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c2f85ebe-70e5-43ad-9581-1b64383ad0be tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:27.232006 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c2f85ebe-70e5-43ad-9581-1b64383ad0be tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:27.447639 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-bc4481e8-e938-4a2b-a0bc-0eaa92f1e7e1 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Flavor limits 0:0:0 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 15 19:56:27.448306 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-bc4481e8-e938-4a2b-a0bc-0eaa92f1e7e1 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Image limits 0:0:0 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 15 19:56:27.448937 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-bc4481e8-e938-4a2b-a0bc-0eaa92f1e7e1 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Flavor pref 0:0:0 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 15 19:56:27.449504 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-bc4481e8-e938-4a2b-a0bc-0eaa92f1e7e1 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Image pref 0:0:0 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 15 19:56:27.450069 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-bc4481e8-e938-4a2b-a0bc-0eaa92f1e7e1 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 15 19:56:27.460303 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bc4481e8-e938-4a2b-a0bc-0eaa92f1e7e1 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:27.460915 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bc4481e8-e938-4a2b-a0bc-0eaa92f1e7e1 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:27.461889 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bc4481e8-e938-4a2b-a0bc-0eaa92f1e7e1 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:27.462485 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bc4481e8-e938-4a2b-a0bc-0eaa92f1e7e1 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:27.485889 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-bc4481e8-e938-4a2b-a0bc-0eaa92f1e7e1 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Getting quotas for project 4d9208f04bcf45e4a5d2ef86825620d3. Resources: {'cores', 'instances', 'ram'} {{(pid=99512) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 15 19:56:27.490164 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-bc4481e8-e938-4a2b-a0bc-0eaa92f1e7e1 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Getting quotas for user 8698c520674549bfbecfa31cd2acb852 and project 4d9208f04bcf45e4a5d2ef86825620d3. Resources: {'cores', 'instances', 'ram'} {{(pid=99512) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 15 19:56:27.519420 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c2f85ebe-70e5-43ad-9581-1b64383ad0be tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:27.528442 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c2f85ebe-70e5-43ad-9581-1b64383ad0be tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1357 microversion: 2.1 time: 0.311931 Apr 15 19:56:27.529095 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 350/612] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:27 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1357 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:56:27.534381 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7c585662-7938-45b5-8edf-498ff00244ca tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fef82769-d345-4b27-944b-aa6ad13e9fc2"}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:56:27.535856 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7c585662-7938-45b5-8edf-498ff00244ca tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:27.544056 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7c585662-7938-45b5-8edf-498ff00244ca tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:27.544773 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7c585662-7938-45b5-8edf-498ff00244ca tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:27.545616 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7c585662-7938-45b5-8edf-498ff00244ca tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:27.546113 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7c585662-7938-45b5-8edf-498ff00244ca tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:27.601276 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-bc4481e8-e938-4a2b-a0bc-0eaa92f1e7e1 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Going to run 1 instances... {{(pid=99512) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 15 19:56:27.603717 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-bc4481e8-e938-4a2b-a0bc-0eaa92f1e7e1 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eb12e164-9ec4-47c2-a915-02b1906e9931',volume_size=None,volume_type=None)] {{(pid=99512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 15 19:56:27.867253 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-bc4481e8-e938-4a2b-a0bc-0eaa92f1e7e1 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.401550 Apr 15 19:56:27.868414 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 263/613] 10.222.0.58 () {60 vars in 1137 bytes} [Thu Apr 15 19:56:26 2021] POST /compute/v2.1/servers => generated 406 bytes in 1403 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 15 19:56:27.877708 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-09d1de24-bc92-4430-8254-6e73ec9b8096 req-d18dc524-5733-4f7e-aba3-9129abe2b840 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0ac4cf-7982-406b-a2f0-115ca5721a10", "name": "network-vif-unplugged", "status": "completed", "tag": "431c18ae-c617-4e1e-bca6-7134661c98e1"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:56:27.879552 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:56:27.879552 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:56:27.889706 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-09d1de24-bc92-4430-8254-6e73ec9b8096 req-d18dc524-5733-4f7e-aba3-9129abe2b840 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:27.890219 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-09d1de24-bc92-4430-8254-6e73ec9b8096 req-d18dc524-5733-4f7e-aba3-9129abe2b840 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:27.908479 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-09d1de24-bc92-4430-8254-6e73ec9b8096 req-d18dc524-5733-4f7e-aba3-9129abe2b840 service nova] Creating event network-vif-unplugged:431c18ae-c617-4e1e-bca6-7134661c98e1 for instance 6c0ac4cf-7982-406b-a2f0-115ca5721a10 on hv-cinder-78638 Apr 15 19:56:27.913731 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-09d1de24-bc92-4430-8254-6e73ec9b8096 req-d18dc524-5733-4f7e-aba3-9129abe2b840 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044091 Apr 15 19:56:27.914383 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 264/614] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:56:27 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:56:27.920891 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-99c09e34-8505-41bb-8566-35402cca0a7a tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c84dba5-4aeb-41d9-8405-d5b7ca419455", "device": "/dev/sdb"}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:56:27.922765 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-99c09e34-8505-41bb-8566-35402cca0a7a tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: a5f4046a-6bc2-4099-afa3-c1a2d16c38f0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:27.931236 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-99c09e34-8505-41bb-8566-35402cca0a7a tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:27.931784 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-99c09e34-8505-41bb-8566-35402cca0a7a tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:27.932630 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-99c09e34-8505-41bb-8566-35402cca0a7a tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:27.933130 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-99c09e34-8505-41bb-8566-35402cca0a7a tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:27.935137 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7c585662-7938-45b5-8edf-498ff00244ca tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.404514 Apr 15 19:56:27.941361 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 351/615] 10.222.0.58 () {60 vars in 1313 bytes} [Thu Apr 15 19:56:27 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/os-volume_attachments => generated 194 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:56:27.948283 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-88a85f88-a537-4fc7-aed8-326d5666c855 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:27.949274 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-88a85f88-a537-4fc7-aed8-326d5666c855 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:28.040038 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-88a85f88-a537-4fc7-aed8-326d5666c855 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:28.050502 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-88a85f88-a537-4fc7-aed8-326d5666c855 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1089 microversion: 2.1 time: 0.107442 Apr 15 19:56:28.051352 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 352/616] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:27 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1089 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:28.092695 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-53ee06ab-9124-42ea-bb2e-2c8d0f168f6c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:28.096067 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-53ee06ab-9124-42ea-bb2e-2c8d0f168f6c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:28.106011 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-53ee06ab-9124-42ea-bb2e-2c8d0f168f6c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:28.107155 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-53ee06ab-9124-42ea-bb2e-2c8d0f168f6c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:28.108270 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-53ee06ab-9124-42ea-bb2e-2c8d0f168f6c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:28.108951 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-53ee06ab-9124-42ea-bb2e-2c8d0f168f6c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:28.390685 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-53ee06ab-9124-42ea-bb2e-2c8d0f168f6c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:28.401140 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-53ee06ab-9124-42ea-bb2e-2c8d0f168f6c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:28.402840 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-53ee06ab-9124-42ea-bb2e-2c8d0f168f6c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:28.404927 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-53ee06ab-9124-42ea-bb2e-2c8d0f168f6c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1723 microversion: 2.20 time: 0.317240 Apr 15 19:56:28.405557 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 353/617] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:28 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1723 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 19:56:28.546831 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-58aa6fcf-105d-4812-afe2-54ce6c0c2b35 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:28.547507 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-58aa6fcf-105d-4812-afe2-54ce6c0c2b35 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:28.564162 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-58aa6fcf-105d-4812-afe2-54ce6c0c2b35 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:28.564687 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-58aa6fcf-105d-4812-afe2-54ce6c0c2b35 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:28.566225 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-58aa6fcf-105d-4812-afe2-54ce6c0c2b35 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:28.566428 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-58aa6fcf-105d-4812-afe2-54ce6c0c2b35 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:28.851524 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-58aa6fcf-105d-4812-afe2-54ce6c0c2b35 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:28.861313 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-58aa6fcf-105d-4812-afe2-54ce6c0c2b35 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1357 microversion: 2.1 time: 0.318812 Apr 15 19:56:28.862148 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 354/618] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:28 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1357 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:56:28.877415 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-99c09e34-8505-41bb-8566-35402cca0a7a tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "POST /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.961529 Apr 15 19:56:28.883079 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 265/619] 10.222.0.58 () {60 vars in 1313 bytes} [Thu Apr 15 19:56:27 2021] POST /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0/os-volume_attachments => generated 194 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:56:29.069404 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-fa3598fa-95c7-49a0-bc17-ebb46010f3c3 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:29.070146 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-fa3598fa-95c7-49a0-bc17-ebb46010f3c3 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:29.078733 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fa3598fa-95c7-49a0-bc17-ebb46010f3c3 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:29.079248 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fa3598fa-95c7-49a0-bc17-ebb46010f3c3 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:29.080129 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fa3598fa-95c7-49a0-bc17-ebb46010f3c3 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:29.080629 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fa3598fa-95c7-49a0-bc17-ebb46010f3c3 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:29.205725 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-fa3598fa-95c7-49a0-bc17-ebb46010f3c3 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:29.216524 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-fa3598fa-95c7-49a0-bc17-ebb46010f3c3 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1187 microversion: 2.1 time: 0.151120 Apr 15 19:56:29.217365 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 355/620] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:29 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1187 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:29.427578 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-8a6f075b-59f0-4807-9002-d589532fa298 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:29.428548 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-8a6f075b-59f0-4807-9002-d589532fa298 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:29.439150 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8a6f075b-59f0-4807-9002-d589532fa298 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:29.440017 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8a6f075b-59f0-4807-9002-d589532fa298 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:29.441053 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8a6f075b-59f0-4807-9002-d589532fa298 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:29.441773 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8a6f075b-59f0-4807-9002-d589532fa298 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:29.675528 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-8a6f075b-59f0-4807-9002-d589532fa298 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:29.687351 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-8a6f075b-59f0-4807-9002-d589532fa298 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:29.689442 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-8a6f075b-59f0-4807-9002-d589532fa298 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:29.690889 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-8a6f075b-59f0-4807-9002-d589532fa298 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1726 microversion: 2.20 time: 0.269210 Apr 15 19:56:29.705007 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 266/621] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:29 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1726 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:56:29.710383 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-fb38b6e1-ce7e-41fe-a2dd-93f112b5d31f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee4f1852-b29a-4aac-840a-7d5e7cfe52b2"}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:56:29.711779 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-fb38b6e1-ce7e-41fe-a2dd-93f112b5d31f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:29.727552 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fb38b6e1-ce7e-41fe-a2dd-93f112b5d31f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:29.728071 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fb38b6e1-ce7e-41fe-a2dd-93f112b5d31f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:29.728925 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fb38b6e1-ce7e-41fe-a2dd-93f112b5d31f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:29.729425 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fb38b6e1-ce7e-41fe-a2dd-93f112b5d31f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:29.881243 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-86e560ec-4c72-4d1d-806b-5db22d00e845 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:29.881928 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-86e560ec-4c72-4d1d-806b-5db22d00e845 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:29.890898 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-86e560ec-4c72-4d1d-806b-5db22d00e845 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:29.892761 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-86e560ec-4c72-4d1d-806b-5db22d00e845 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:29.893985 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-86e560ec-4c72-4d1d-806b-5db22d00e845 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:29.894512 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-86e560ec-4c72-4d1d-806b-5db22d00e845 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:30.233024 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-86e560ec-4c72-4d1d-806b-5db22d00e845 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:30.243700 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-86e560ec-4c72-4d1d-806b-5db22d00e845 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1357 microversion: 2.1 time: 0.366882 Apr 15 19:56:30.244681 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 267/622] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:29 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1357 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:30.250408 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-3a8f040d-c236-4223-8e4b-8d4d5b85585a tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:30.251080 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-3a8f040d-c236-4223-8e4b-8d4d5b85585a tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:30.259778 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3a8f040d-c236-4223-8e4b-8d4d5b85585a tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:30.260503 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3a8f040d-c236-4223-8e4b-8d4d5b85585a tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:30.261522 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3a8f040d-c236-4223-8e4b-8d4d5b85585a tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:30.262017 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3a8f040d-c236-4223-8e4b-8d4d5b85585a tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:30.362468 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-fb38b6e1-ce7e-41fe-a2dd-93f112b5d31f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.656289 Apr 15 19:56:30.363656 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 356/623] 10.222.0.58 () {62 vars in 1354 bytes} [Thu Apr 15 19:56:29 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/os-volume_attachments => generated 188 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:56:30.526460 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3a8f040d-c236-4223-8e4b-8d4d5b85585a tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:30.539245 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-3a8f040d-c236-4223-8e4b-8d4d5b85585a tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1273 microversion: 2.1 time: 0.293312 Apr 15 19:56:30.540294 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 268/624] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:30 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1273 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:30.611829 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-45ffd8f9-13a0-4783-9dcc-c9c84c995319 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:56:30.612409 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-45ffd8f9-13a0-4783-9dcc-c9c84c995319 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:30.620763 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-45ffd8f9-13a0-4783-9dcc-c9c84c995319 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:30.621272 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-45ffd8f9-13a0-4783-9dcc-c9c84c995319 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:30.622458 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-45ffd8f9-13a0-4783-9dcc-c9c84c995319 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:30.622635 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-45ffd8f9-13a0-4783-9dcc-c9c84c995319 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:30.801311 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: ERROR oslo.messaging._drivers.impl_rabbit [None req-45ffd8f9-13a0-4783-9dcc-c9c84c995319 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [66d875b5-15f1-4257-be3e-a6727cb67e29] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 15 19:56:31.261639 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-20923f71-c989-4880-b573-a93aa5f758b0 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:31.263008 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-20923f71-c989-4880-b573-a93aa5f758b0 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:31.271715 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-20923f71-c989-4880-b573-a93aa5f758b0 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:31.272237 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-20923f71-c989-4880-b573-a93aa5f758b0 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:31.273093 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-20923f71-c989-4880-b573-a93aa5f758b0 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:31.273776 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-20923f71-c989-4880-b573-a93aa5f758b0 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:31.510692 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-20923f71-c989-4880-b573-a93aa5f758b0 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:31.520569 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-20923f71-c989-4880-b573-a93aa5f758b0 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1357 microversion: 2.1 time: 0.262824 Apr 15 19:56:31.521423 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 269/625] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:31 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1357 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:31.558373 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7ab1993d-2df8-42f2-a8fa-f7dc9e5a38a5 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:31.559423 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7ab1993d-2df8-42f2-a8fa-f7dc9e5a38a5 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:31.570197 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7ab1993d-2df8-42f2-a8fa-f7dc9e5a38a5 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:31.571311 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7ab1993d-2df8-42f2-a8fa-f7dc9e5a38a5 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:31.572405 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7ab1993d-2df8-42f2-a8fa-f7dc9e5a38a5 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:31.574198 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7ab1993d-2df8-42f2-a8fa-f7dc9e5a38a5 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:31.823459 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-7ab1993d-2df8-42f2-a8fa-f7dc9e5a38a5 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:31.834754 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO oslo.messaging._drivers.impl_rabbit [None req-45ffd8f9-13a0-4783-9dcc-c9c84c995319 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [66d875b5-15f1-4257-be3e-a6727cb67e29] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 52640. Apr 15 19:56:31.836075 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7ab1993d-2df8-42f2-a8fa-f7dc9e5a38a5 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1273 microversion: 2.1 time: 0.281618 Apr 15 19:56:31.836884 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 270/626] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:31 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1273 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:31.848651 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-4160193a-a378-4f33-993d-00f817b1f33e req-a3301ce6-d711-40fa-98c9-9da8c91d84a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1ea7a7c-3e3e-47c5-8955-a3b27a52d453", "name": "network-vif-plugged", "status": "completed", "tag": "619a8492-f932-4048-8258-fe9757a50525"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:56:31.850431 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:56:31.850431 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:56:31.853406 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-45ffd8f9-13a0-4783-9dcc-c9c84c995319 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action" status: 202 len: 0 microversion: 2.20 time: 1.245261 Apr 15 19:56:31.854054 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 357/627] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:56:30 2021] POST /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/action => generated 0 bytes in 1247 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 15 19:56:31.865385 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-4160193a-a378-4f33-993d-00f817b1f33e req-a3301ce6-d711-40fa-98c9-9da8c91d84a1 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:31.865779 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b903eadf-ad1b-4507-9148-dc8cede2a565 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:31.866089 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-4160193a-a378-4f33-993d-00f817b1f33e req-a3301ce6-d711-40fa-98c9-9da8c91d84a1 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:31.869024 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b903eadf-ad1b-4507-9148-dc8cede2a565 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:31.889269 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-4160193a-a378-4f33-993d-00f817b1f33e req-a3301ce6-d711-40fa-98c9-9da8c91d84a1 service nova] Creating event network-vif-plugged:619a8492-f932-4048-8258-fe9757a50525 for instance b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 on hv-cinder-78638 Apr 15 19:56:31.894784 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-4160193a-a378-4f33-993d-00f817b1f33e req-a3301ce6-d711-40fa-98c9-9da8c91d84a1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049967 Apr 15 19:56:31.895806 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 271/628] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:56:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 15 19:56:31.898096 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b903eadf-ad1b-4507-9148-dc8cede2a565 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:31.898621 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b903eadf-ad1b-4507-9148-dc8cede2a565 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:31.899543 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b903eadf-ad1b-4507-9148-dc8cede2a565 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:31.900042 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b903eadf-ad1b-4507-9148-dc8cede2a565 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:31.901844 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-9edff6ec-5292-48be-93f3-b199270e8300 req-e31dcf3a-7ae7-437e-84ac-a3d0b8b513c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c241efcb-ba90-43dd-a6c3-393b77086172", "tag": "32a87087-67a6-454d-8830-c295f0d8e889"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:56:31.903903 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:56:31.903903 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:56:31.914727 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-9edff6ec-5292-48be-93f3-b199270e8300 req-e31dcf3a-7ae7-437e-84ac-a3d0b8b513c6 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:31.915805 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-9edff6ec-5292-48be-93f3-b199270e8300 req-e31dcf3a-7ae7-437e-84ac-a3d0b8b513c6 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:31.939556 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-9edff6ec-5292-48be-93f3-b199270e8300 req-e31dcf3a-7ae7-437e-84ac-a3d0b8b513c6 service nova] Creating event network-changed:32a87087-67a6-454d-8830-c295f0d8e889 for instance c241efcb-ba90-43dd-a6c3-393b77086172 on hv-cinder-78638 Apr 15 19:56:31.951055 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-9edff6ec-5292-48be-93f3-b199270e8300 req-e31dcf3a-7ae7-437e-84ac-a3d0b8b513c6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053101 Apr 15 19:56:31.952090 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 272/629] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:56:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:56:32.393439 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b903eadf-ad1b-4507-9148-dc8cede2a565 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:32.405271 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b903eadf-ad1b-4507-9148-dc8cede2a565 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:32.406916 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b903eadf-ad1b-4507-9148-dc8cede2a565 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:32.409563 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b903eadf-ad1b-4507-9148-dc8cede2a565 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1752 microversion: 2.20 time: 0.550880 Apr 15 19:56:32.410296 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 358/630] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:31 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1752 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 19:56:32.539835 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e6088c71-f94c-4069-82c9-69304741b531 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:32.540843 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e6088c71-f94c-4069-82c9-69304741b531 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:32.549722 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e6088c71-f94c-4069-82c9-69304741b531 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:32.550309 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e6088c71-f94c-4069-82c9-69304741b531 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:32.551217 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e6088c71-f94c-4069-82c9-69304741b531 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:32.551910 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e6088c71-f94c-4069-82c9-69304741b531 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:32.808015 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-e6088c71-f94c-4069-82c9-69304741b531 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:32.817499 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e6088c71-f94c-4069-82c9-69304741b531 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1357 microversion: 2.1 time: 0.281931 Apr 15 19:56:32.818151 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 273/631] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:32 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1357 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:32.854234 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-51090b04-1785-48dc-bfa5-f824e06514cc tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:32.854915 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-51090b04-1785-48dc-bfa5-f824e06514cc tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:32.863714 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-51090b04-1785-48dc-bfa5-f824e06514cc tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:32.864271 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-51090b04-1785-48dc-bfa5-f824e06514cc tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:32.865175 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-51090b04-1785-48dc-bfa5-f824e06514cc tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:32.865664 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-51090b04-1785-48dc-bfa5-f824e06514cc tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:33.089941 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-51090b04-1785-48dc-bfa5-f824e06514cc tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:33.098817 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-51090b04-1785-48dc-bfa5-f824e06514cc tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1273 microversion: 2.1 time: 0.248697 Apr 15 19:56:33.099643 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 359/632] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:32 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1273 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:33.430528 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d4514b28-33fa-4f6f-87e3-311a219c076e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:33.431000 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d4514b28-33fa-4f6f-87e3-311a219c076e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:33.450977 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d4514b28-33fa-4f6f-87e3-311a219c076e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:33.451525 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d4514b28-33fa-4f6f-87e3-311a219c076e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:33.452387 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d4514b28-33fa-4f6f-87e3-311a219c076e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:33.452885 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d4514b28-33fa-4f6f-87e3-311a219c076e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:33.729921 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d4514b28-33fa-4f6f-87e3-311a219c076e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:33.740195 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d4514b28-33fa-4f6f-87e3-311a219c076e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:33.742627 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d4514b28-33fa-4f6f-87e3-311a219c076e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:33.743949 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d4514b28-33fa-4f6f-87e3-311a219c076e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1754 microversion: 2.20 time: 0.317923 Apr 15 19:56:33.744547 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 274/633] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:33 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1754 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:56:33.836786 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-5a53899a-b2ac-4568-b2ca-3f476c529843 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:33.837917 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-5a53899a-b2ac-4568-b2ca-3f476c529843 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:33.846722 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5a53899a-b2ac-4568-b2ca-3f476c529843 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:33.848062 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5a53899a-b2ac-4568-b2ca-3f476c529843 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:33.849109 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5a53899a-b2ac-4568-b2ca-3f476c529843 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:33.849587 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5a53899a-b2ac-4568-b2ca-3f476c529843 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:34.081767 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-5a53899a-b2ac-4568-b2ca-3f476c529843 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:34.090635 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-5a53899a-b2ac-4568-b2ca-3f476c529843 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1548 microversion: 2.1 time: 0.258332 Apr 15 19:56:34.091727 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 360/634] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:33 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1548 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:34.109530 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6d1d738d-ae73-4a70-91f3-8f4d5fb55a7d tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:34.110199 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6d1d738d-ae73-4a70-91f3-8f4d5fb55a7d tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:34.117084 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-51128aee-2fff-421c-8ebe-10080f669215 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:34.117764 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-51128aee-2fff-421c-8ebe-10080f669215 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:34.118143 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6d1d738d-ae73-4a70-91f3-8f4d5fb55a7d tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:34.118652 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6d1d738d-ae73-4a70-91f3-8f4d5fb55a7d tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:34.119546 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6d1d738d-ae73-4a70-91f3-8f4d5fb55a7d tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:34.120038 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6d1d738d-ae73-4a70-91f3-8f4d5fb55a7d tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:34.125589 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-51128aee-2fff-421c-8ebe-10080f669215 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:34.126103 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-51128aee-2fff-421c-8ebe-10080f669215 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:34.126933 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-51128aee-2fff-421c-8ebe-10080f669215 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:34.127456 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-51128aee-2fff-421c-8ebe-10080f669215 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:34.441074 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-6d1d738d-ae73-4a70-91f3-8f4d5fb55a7d tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:34.445503 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-51128aee-2fff-421c-8ebe-10080f669215 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:34.450060 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6d1d738d-ae73-4a70-91f3-8f4d5fb55a7d tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1548 microversion: 2.1 time: 0.345054 Apr 15 19:56:34.451296 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 275/635] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:34 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1548 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:34.454859 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-51128aee-2fff-421c-8ebe-10080f669215 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1273 microversion: 2.1 time: 0.341799 Apr 15 19:56:34.455495 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 361/636] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:34 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1273 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:56:34.467585 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-bffc139d-2770-4681-87f4-926b28f185fb tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:34.472202 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:56:34.472202 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:56:34.473347 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-bffc139d-2770-4681-87f4-926b28f185fb tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:34.474201 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-bffc139d-2770-4681-87f4-926b28f185fb tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Searching by: {'deleted': False, 'project_id': 'c4982826645345ceb30d47046d10f317'} {{(pid=99512) get_all /opt/stack/nova/nova/compute/api.py:2857}} Apr 15 19:56:34.480349 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bffc139d-2770-4681-87f4-926b28f185fb tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:34.480863 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bffc139d-2770-4681-87f4-926b28f185fb tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:34.481822 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bffc139d-2770-4681-87f4-926b28f185fb tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:34.482359 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bffc139d-2770-4681-87f4-926b28f185fb tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:34.579647 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.multi_cell_list [None req-bffc139d-2770-4681-87f4-926b28f185fb tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=99512) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:376}} Apr 15 19:56:34.680209 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-bffc139d-2770-4681-87f4-926b28f185fb tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.216676 Apr 15 19:56:34.681138 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 276/637] 10.222.0.58 () {58 vars in 1115 bytes} [Thu Apr 15 19:56:34 2021] GET /compute/v2.1/servers => generated 343 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:56:34.692091 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-1fa3258d-5785-47be-bfc3-e9f080654f10 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:34.692772 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-1fa3258d-5785-47be-bfc3-e9f080654f10 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:34.701563 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1fa3258d-5785-47be-bfc3-e9f080654f10 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:34.702073 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1fa3258d-5785-47be-bfc3-e9f080654f10 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:34.702918 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1fa3258d-5785-47be-bfc3-e9f080654f10 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:34.703445 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1fa3258d-5785-47be-bfc3-e9f080654f10 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:34.764806 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b32a50b8-c99c-4f3a-8452-ee7c250ce2a7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:34.765594 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b32a50b8-c99c-4f3a-8452-ee7c250ce2a7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:34.773475 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b32a50b8-c99c-4f3a-8452-ee7c250ce2a7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:34.774064 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b32a50b8-c99c-4f3a-8452-ee7c250ce2a7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:34.774981 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b32a50b8-c99c-4f3a-8452-ee7c250ce2a7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:34.775563 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b32a50b8-c99c-4f3a-8452-ee7c250ce2a7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:35.002772 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-1fa3258d-5785-47be-bfc3-e9f080654f10 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:35.003494 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-1fa3258d-5785-47be-bfc3-e9f080654f10 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1548 microversion: 2.1 time: 0.315494 Apr 15 19:56:35.004388 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 362/638] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:34 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1548 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:35.009096 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-8aebf658-141a-4501-840b-1e136506e207 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:56:35.018312 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8aebf658-141a-4501-840b-1e136506e207 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:35.018849 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8aebf658-141a-4501-840b-1e136506e207 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:35.069802 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b32a50b8-c99c-4f3a-8452-ee7c250ce2a7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:35.080618 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b32a50b8-c99c-4f3a-8452-ee7c250ce2a7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:35.083036 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b32a50b8-c99c-4f3a-8452-ee7c250ce2a7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:35.083176 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-8aebf658-141a-4501-840b-1e136506e207 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Going to try to stop instance {{(pid=99511) force_stop /opt/stack/nova/nova/compute/api.py:2604}} Apr 15 19:56:35.084314 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b32a50b8-c99c-4f3a-8452-ee7c250ce2a7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1754 microversion: 2.20 time: 0.324205 Apr 15 19:56:35.085293 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 277/639] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:34 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1754 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:56:35.160064 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-8aebf658-141a-4501-840b-1e136506e207 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 202 len: 0 microversion: 2.1 time: 0.154219 Apr 15 19:56:35.160683 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 363/640] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:56:35 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:56:35.170131 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-09da4677-150a-437d-bb92-4a3a140e5054 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:35.170939 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-09da4677-150a-437d-bb92-4a3a140e5054 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:35.180659 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-09da4677-150a-437d-bb92-4a3a140e5054 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:35.181174 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-09da4677-150a-437d-bb92-4a3a140e5054 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:35.182024 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-09da4677-150a-437d-bb92-4a3a140e5054 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:35.182517 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-09da4677-150a-437d-bb92-4a3a140e5054 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:35.407316 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-09da4677-150a-437d-bb92-4a3a140e5054 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:35.417985 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-09da4677-150a-437d-bb92-4a3a140e5054 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1721 microversion: 2.1 time: 0.252723 Apr 15 19:56:35.418621 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 278/641] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:35 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1721 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:35.474059 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d3f5ee70-cd89-4952-901a-7374b902e63c tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:35.474839 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d3f5ee70-cd89-4952-901a-7374b902e63c tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:35.483558 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d3f5ee70-cd89-4952-901a-7374b902e63c tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:35.484071 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d3f5ee70-cd89-4952-901a-7374b902e63c tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:35.484925 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d3f5ee70-cd89-4952-901a-7374b902e63c tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:35.485423 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d3f5ee70-cd89-4952-901a-7374b902e63c tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:35.720896 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d3f5ee70-cd89-4952-901a-7374b902e63c tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:35.730541 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d3f5ee70-cd89-4952-901a-7374b902e63c tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1273 microversion: 2.1 time: 0.260719 Apr 15 19:56:35.735387 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 364/642] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:35 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1273 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:36.104308 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-5127837b-6e04-4d73-b8af-b1f908811cb0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:36.105132 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-5127837b-6e04-4d73-b8af-b1f908811cb0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:36.113498 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5127837b-6e04-4d73-b8af-b1f908811cb0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:36.114046 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5127837b-6e04-4d73-b8af-b1f908811cb0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:36.114891 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5127837b-6e04-4d73-b8af-b1f908811cb0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:36.115390 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5127837b-6e04-4d73-b8af-b1f908811cb0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:36.438132 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c423c9c2-0065-4392-8d16-884cb6da6d78 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:36.438732 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c423c9c2-0065-4392-8d16-884cb6da6d78 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:36.447363 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c423c9c2-0065-4392-8d16-884cb6da6d78 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:36.447884 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c423c9c2-0065-4392-8d16-884cb6da6d78 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:36.448742 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c423c9c2-0065-4392-8d16-884cb6da6d78 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:36.449238 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c423c9c2-0065-4392-8d16-884cb6da6d78 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:36.597575 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-5127837b-6e04-4d73-b8af-b1f908811cb0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:36.608463 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-5127837b-6e04-4d73-b8af-b1f908811cb0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:36.610341 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-5127837b-6e04-4d73-b8af-b1f908811cb0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:36.611816 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-5127837b-6e04-4d73-b8af-b1f908811cb0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1754 microversion: 2.20 time: 0.511557 Apr 15 19:56:36.612460 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 279/643] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:36 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1754 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:56:36.688281 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c423c9c2-0065-4392-8d16-884cb6da6d78 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:36.699451 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c423c9c2-0065-4392-8d16-884cb6da6d78 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1721 microversion: 2.1 time: 0.266220 Apr 15 19:56:36.700426 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 365/644] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:36 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1721 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:36.749841 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ea26bad7-2960-4313-a0ea-c0eb9b641da7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:36.750546 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ea26bad7-2960-4313-a0ea-c0eb9b641da7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:36.758551 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ea26bad7-2960-4313-a0ea-c0eb9b641da7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:36.759059 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ea26bad7-2960-4313-a0ea-c0eb9b641da7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:36.759928 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ea26bad7-2960-4313-a0ea-c0eb9b641da7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:36.760419 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ea26bad7-2960-4313-a0ea-c0eb9b641da7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:36.892274 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9f08b5aa-07d1-4ccc-b6d7-4b3443a34395 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c59deb63-0aea-426b-b2f8-83b066297d9a"}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:56:36.893681 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9f08b5aa-07d1-4ccc-b6d7-4b3443a34395 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:36.902153 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9f08b5aa-07d1-4ccc-b6d7-4b3443a34395 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:36.902429 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9f08b5aa-07d1-4ccc-b6d7-4b3443a34395 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:36.903324 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9f08b5aa-07d1-4ccc-b6d7-4b3443a34395 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:36.903844 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9f08b5aa-07d1-4ccc-b6d7-4b3443a34395 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:37.067991 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ea26bad7-2960-4313-a0ea-c0eb9b641da7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:37.076835 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ea26bad7-2960-4313-a0ea-c0eb9b641da7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1273 microversion: 2.1 time: 0.331716 Apr 15 19:56:37.077557 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 280/645] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:36 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1273 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:37.311611 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9f08b5aa-07d1-4ccc-b6d7-4b3443a34395 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "POST /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.423232 Apr 15 19:56:37.317214 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 366/646] 10.222.0.58 () {60 vars in 1313 bytes} [Thu Apr 15 19:56:36 2021] POST /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453/os-volume_attachments => generated 194 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:56:37.631351 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-bc717bee-fa02-4fb4-9ae3-8afb119847d0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:37.632025 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-bc717bee-fa02-4fb4-9ae3-8afb119847d0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:37.640315 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bc717bee-fa02-4fb4-9ae3-8afb119847d0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:37.640827 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bc717bee-fa02-4fb4-9ae3-8afb119847d0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:37.641657 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bc717bee-fa02-4fb4-9ae3-8afb119847d0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:37.642147 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bc717bee-fa02-4fb4-9ae3-8afb119847d0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:37.720023 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-95d37724-ab60-4d0a-ba9f-8f55f75562cc tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:37.720732 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-95d37724-ab60-4d0a-ba9f-8f55f75562cc tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:37.729840 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-95d37724-ab60-4d0a-ba9f-8f55f75562cc tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:37.730347 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-95d37724-ab60-4d0a-ba9f-8f55f75562cc tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:37.731217 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-95d37724-ab60-4d0a-ba9f-8f55f75562cc tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:37.731737 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-95d37724-ab60-4d0a-ba9f-8f55f75562cc tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:37.906338 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-bc717bee-fa02-4fb4-9ae3-8afb119847d0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:37.916850 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-bc717bee-fa02-4fb4-9ae3-8afb119847d0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:37.918570 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-bc717bee-fa02-4fb4-9ae3-8afb119847d0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:37.919840 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-bc717bee-fa02-4fb4-9ae3-8afb119847d0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1754 microversion: 2.20 time: 0.292586 Apr 15 19:56:37.920970 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 281/647] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:37 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1754 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:56:37.982035 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-95d37724-ab60-4d0a-ba9f-8f55f75562cc tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:37.991518 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-95d37724-ab60-4d0a-ba9f-8f55f75562cc tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1721 microversion: 2.1 time: 0.277180 Apr 15 19:56:37.992144 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 367/648] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:37 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1721 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:38.095329 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-0e63aca0-ad03-4114-be7a-e97fd317cf50 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:38.096003 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-0e63aca0-ad03-4114-be7a-e97fd317cf50 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:38.104254 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0e63aca0-ad03-4114-be7a-e97fd317cf50 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:38.104763 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0e63aca0-ad03-4114-be7a-e97fd317cf50 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:38.105596 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0e63aca0-ad03-4114-be7a-e97fd317cf50 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:38.106100 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0e63aca0-ad03-4114-be7a-e97fd317cf50 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:38.318781 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-0e63aca0-ad03-4114-be7a-e97fd317cf50 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:38.328136 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-0e63aca0-ad03-4114-be7a-e97fd317cf50 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1273 microversion: 2.1 time: 0.237095 Apr 15 19:56:38.328758 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 282/649] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:38 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1273 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:38.940661 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f3523548-8fb0-4b99-9e69-e1dd04a3c86d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:38.941273 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f3523548-8fb0-4b99-9e69-e1dd04a3c86d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:38.949591 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f3523548-8fb0-4b99-9e69-e1dd04a3c86d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:38.950106 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f3523548-8fb0-4b99-9e69-e1dd04a3c86d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:38.950942 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f3523548-8fb0-4b99-9e69-e1dd04a3c86d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:38.951470 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f3523548-8fb0-4b99-9e69-e1dd04a3c86d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:39.010155 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-30e7f9f6-5144-4e9e-80c0-53f70e4e71b9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:39.011000 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-30e7f9f6-5144-4e9e-80c0-53f70e4e71b9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:39.018715 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-30e7f9f6-5144-4e9e-80c0-53f70e4e71b9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:39.019221 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-30e7f9f6-5144-4e9e-80c0-53f70e4e71b9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:39.020075 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-30e7f9f6-5144-4e9e-80c0-53f70e4e71b9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:39.020563 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-30e7f9f6-5144-4e9e-80c0-53f70e4e71b9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:39.228956 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f3523548-8fb0-4b99-9e69-e1dd04a3c86d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:39.241304 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f3523548-8fb0-4b99-9e69-e1dd04a3c86d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:39.242999 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f3523548-8fb0-4b99-9e69-e1dd04a3c86d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:39.244441 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f3523548-8fb0-4b99-9e69-e1dd04a3c86d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1754 microversion: 2.20 time: 0.308004 Apr 15 19:56:39.245054 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 368/650] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:38 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1754 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:56:39.289408 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-30e7f9f6-5144-4e9e-80c0-53f70e4e71b9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:39.299656 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-30e7f9f6-5144-4e9e-80c0-53f70e4e71b9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1721 microversion: 2.1 time: 0.293467 Apr 15 19:56:39.300282 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 283/651] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:39 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1721 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:39.346490 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ea6e7587-12ff-4a79-b038-19e24935bdc7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:39.347164 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ea6e7587-12ff-4a79-b038-19e24935bdc7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:39.354985 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ea6e7587-12ff-4a79-b038-19e24935bdc7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:39.355568 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ea6e7587-12ff-4a79-b038-19e24935bdc7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:39.356405 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ea6e7587-12ff-4a79-b038-19e24935bdc7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:39.357527 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ea6e7587-12ff-4a79-b038-19e24935bdc7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:39.564580 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ea6e7587-12ff-4a79-b038-19e24935bdc7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:39.573383 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ea6e7587-12ff-4a79-b038-19e24935bdc7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1273 microversion: 2.1 time: 0.230849 Apr 15 19:56:39.574003 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 369/652] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:39 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1273 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:40.264379 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-883ad295-6bd3-40ec-8d07-e2a6209ae835 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:40.265200 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-883ad295-6bd3-40ec-8d07-e2a6209ae835 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:40.273197 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-883ad295-6bd3-40ec-8d07-e2a6209ae835 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:40.273708 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-883ad295-6bd3-40ec-8d07-e2a6209ae835 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:40.274548 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-883ad295-6bd3-40ec-8d07-e2a6209ae835 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:40.275096 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-883ad295-6bd3-40ec-8d07-e2a6209ae835 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:40.318218 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7ff40f95-2bb5-4b60-a695-7d4199a6ec8c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:40.319198 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7ff40f95-2bb5-4b60-a695-7d4199a6ec8c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:40.327557 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7ff40f95-2bb5-4b60-a695-7d4199a6ec8c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:40.328067 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7ff40f95-2bb5-4b60-a695-7d4199a6ec8c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:40.328952 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7ff40f95-2bb5-4b60-a695-7d4199a6ec8c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:40.329448 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7ff40f95-2bb5-4b60-a695-7d4199a6ec8c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:40.596546 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-883ad295-6bd3-40ec-8d07-e2a6209ae835 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:40.607009 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-883ad295-6bd3-40ec-8d07-e2a6209ae835 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:40.608690 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-883ad295-6bd3-40ec-8d07-e2a6209ae835 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:40.609893 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-883ad295-6bd3-40ec-8d07-e2a6209ae835 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1754 microversion: 2.20 time: 0.350303 Apr 15 19:56:40.610544 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 284/653] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:40 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1754 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:56:40.628985 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-5565337b-84cb-4830-b6ee-4bb8fa867539 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:40.629957 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-5565337b-84cb-4830-b6ee-4bb8fa867539 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:40.639986 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5565337b-84cb-4830-b6ee-4bb8fa867539 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:40.640603 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5565337b-84cb-4830-b6ee-4bb8fa867539 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:40.641532 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5565337b-84cb-4830-b6ee-4bb8fa867539 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:40.642098 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5565337b-84cb-4830-b6ee-4bb8fa867539 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:40.676154 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-7ff40f95-2bb5-4b60-a695-7d4199a6ec8c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:40.696430 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7ff40f95-2bb5-4b60-a695-7d4199a6ec8c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1721 microversion: 2.1 time: 0.382292 Apr 15 19:56:40.697056 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 370/654] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:40 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1721 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:40.868375 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-5565337b-84cb-4830-b6ee-4bb8fa867539 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:40.877247 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-5565337b-84cb-4830-b6ee-4bb8fa867539 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1273 microversion: 2.1 time: 0.252880 Apr 15 19:56:40.877860 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 285/655] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:40 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1273 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:41.629428 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-cf408095-5b56-49e8-ba72-3b9a1ef1828f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:41.630105 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-cf408095-5b56-49e8-ba72-3b9a1ef1828f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:41.639061 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cf408095-5b56-49e8-ba72-3b9a1ef1828f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:41.639605 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cf408095-5b56-49e8-ba72-3b9a1ef1828f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:41.640442 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cf408095-5b56-49e8-ba72-3b9a1ef1828f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:41.640934 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cf408095-5b56-49e8-ba72-3b9a1ef1828f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:41.716562 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c989aa1d-ca3f-46bd-bbe3-a39905de0fb3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:41.717621 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c989aa1d-ca3f-46bd-bbe3-a39905de0fb3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:41.727180 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c989aa1d-ca3f-46bd-bbe3-a39905de0fb3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:41.727749 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c989aa1d-ca3f-46bd-bbe3-a39905de0fb3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:41.728597 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c989aa1d-ca3f-46bd-bbe3-a39905de0fb3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:41.729089 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c989aa1d-ca3f-46bd-bbe3-a39905de0fb3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:41.919314 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-cf408095-5b56-49e8-ba72-3b9a1ef1828f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:41.936918 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-cf408095-5b56-49e8-ba72-3b9a1ef1828f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:41.939211 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-cf408095-5b56-49e8-ba72-3b9a1ef1828f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:41.940689 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-cf408095-5b56-49e8-ba72-3b9a1ef1828f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1754 microversion: 2.20 time: 0.315376 Apr 15 19:56:41.953914 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 371/656] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:41 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1754 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:56:41.954269 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-2e9c1ae3-36b7-40be-b876-da99a67276d7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:41.955094 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-2e9c1ae3-36b7-40be-b876-da99a67276d7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:41.963414 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2e9c1ae3-36b7-40be-b876-da99a67276d7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:41.963923 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2e9c1ae3-36b7-40be-b876-da99a67276d7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:41.964818 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2e9c1ae3-36b7-40be-b876-da99a67276d7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:41.965312 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2e9c1ae3-36b7-40be-b876-da99a67276d7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:42.018741 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c989aa1d-ca3f-46bd-bbe3-a39905de0fb3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:42.030403 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c989aa1d-ca3f-46bd-bbe3-a39905de0fb3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1721 microversion: 2.1 time: 0.317883 Apr 15 19:56:42.031179 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 286/657] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:41 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1721 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:42.212805 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-2e9c1ae3-36b7-40be-b876-da99a67276d7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:42.222465 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-2e9c1ae3-36b7-40be-b876-da99a67276d7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1273 microversion: 2.1 time: 0.271873 Apr 15 19:56:42.223319 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 372/658] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:41 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1273 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:42.961275 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-703101ab-3b85-4686-95d8-252d8278221d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:42.962056 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-703101ab-3b85-4686-95d8-252d8278221d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:42.970364 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-703101ab-3b85-4686-95d8-252d8278221d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:42.970870 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-703101ab-3b85-4686-95d8-252d8278221d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:42.971719 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-703101ab-3b85-4686-95d8-252d8278221d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:42.972211 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-703101ab-3b85-4686-95d8-252d8278221d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:43.049657 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-afa2ae42-7b69-4dba-a543-032c6473e566 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:43.050624 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-afa2ae42-7b69-4dba-a543-032c6473e566 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:43.058586 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-afa2ae42-7b69-4dba-a543-032c6473e566 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:43.059232 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-afa2ae42-7b69-4dba-a543-032c6473e566 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:43.060291 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-afa2ae42-7b69-4dba-a543-032c6473e566 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:43.060889 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-afa2ae42-7b69-4dba-a543-032c6473e566 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:43.242703 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-703101ab-3b85-4686-95d8-252d8278221d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:43.253416 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-703101ab-3b85-4686-95d8-252d8278221d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:43.255142 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-703101ab-3b85-4686-95d8-252d8278221d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:43.256439 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-703101ab-3b85-4686-95d8-252d8278221d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1754 microversion: 2.20 time: 0.299259 Apr 15 19:56:43.267749 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 287/659] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:42 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1754 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 19:56:43.267749 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a3c5bf97-991e-47f3-a6a6-f39db8c035f8 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:43.267749 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a3c5bf97-991e-47f3-a6a6-f39db8c035f8 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:43.271904 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a3c5bf97-991e-47f3-a6a6-f39db8c035f8 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:43.272418 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a3c5bf97-991e-47f3-a6a6-f39db8c035f8 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:43.273267 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a3c5bf97-991e-47f3-a6a6-f39db8c035f8 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:43.273761 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a3c5bf97-991e-47f3-a6a6-f39db8c035f8 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:43.335060 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-afa2ae42-7b69-4dba-a543-032c6473e566 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:43.345225 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-afa2ae42-7b69-4dba-a543-032c6473e566 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1721 microversion: 2.1 time: 0.299652 Apr 15 19:56:43.355972 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 373/660] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:43 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1721 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:43.489412 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a3c5bf97-991e-47f3-a6a6-f39db8c035f8 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:43.498385 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a3c5bf97-991e-47f3-a6a6-f39db8c035f8 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1261 microversion: 2.1 time: 0.240316 Apr 15 19:56:43.499004 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 288/661] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:43 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1261 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:44.274657 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-55fe8cdb-0f7d-4ef2-a43f-1553819a9242 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:44.275258 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-55fe8cdb-0f7d-4ef2-a43f-1553819a9242 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:44.283057 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-55fe8cdb-0f7d-4ef2-a43f-1553819a9242 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:44.283591 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-55fe8cdb-0f7d-4ef2-a43f-1553819a9242 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:44.284435 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-55fe8cdb-0f7d-4ef2-a43f-1553819a9242 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:44.284924 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-55fe8cdb-0f7d-4ef2-a43f-1553819a9242 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:44.366811 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-51e2e076-bf01-4f84-b7c7-dec2aa1af4ab tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:44.367768 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-51e2e076-bf01-4f84-b7c7-dec2aa1af4ab tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:44.376320 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-51e2e076-bf01-4f84-b7c7-dec2aa1af4ab tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:44.376949 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-51e2e076-bf01-4f84-b7c7-dec2aa1af4ab tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:44.377981 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-51e2e076-bf01-4f84-b7c7-dec2aa1af4ab tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:44.378713 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-51e2e076-bf01-4f84-b7c7-dec2aa1af4ab tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:44.559208 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-55fe8cdb-0f7d-4ef2-a43f-1553819a9242 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:44.570035 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-55fe8cdb-0f7d-4ef2-a43f-1553819a9242 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:44.571742 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-55fe8cdb-0f7d-4ef2-a43f-1553819a9242 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:44.572958 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-55fe8cdb-0f7d-4ef2-a43f-1553819a9242 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1754 microversion: 2.20 time: 0.302352 Apr 15 19:56:44.573612 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 374/662] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:44 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1754 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:56:44.580239 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6ff391eb-a860-4aa2-a4c7-bbb0035d9d7b tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:44.581312 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6ff391eb-a860-4aa2-a4c7-bbb0035d9d7b tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:44.595613 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6ff391eb-a860-4aa2-a4c7-bbb0035d9d7b tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:44.596227 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6ff391eb-a860-4aa2-a4c7-bbb0035d9d7b tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:44.597181 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6ff391eb-a860-4aa2-a4c7-bbb0035d9d7b tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:44.597767 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6ff391eb-a860-4aa2-a4c7-bbb0035d9d7b tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:44.649982 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-51e2e076-bf01-4f84-b7c7-dec2aa1af4ab tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:44.661189 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-51e2e076-bf01-4f84-b7c7-dec2aa1af4ab tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1721 microversion: 2.1 time: 0.300958 Apr 15 19:56:44.661911 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 289/663] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:44 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1721 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:44.861375 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-6ff391eb-a860-4aa2-a4c7-bbb0035d9d7b tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:44.870372 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6ff391eb-a860-4aa2-a4c7-bbb0035d9d7b tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1261 microversion: 2.1 time: 0.295569 Apr 15 19:56:44.871041 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 375/664] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:44 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1261 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:45.593736 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d968cc3d-f777-459d-a9cc-50110ecacc41 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:45.594400 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d968cc3d-f777-459d-a9cc-50110ecacc41 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:45.602186 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d968cc3d-f777-459d-a9cc-50110ecacc41 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:45.602693 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d968cc3d-f777-459d-a9cc-50110ecacc41 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:45.603532 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d968cc3d-f777-459d-a9cc-50110ecacc41 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:45.604023 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d968cc3d-f777-459d-a9cc-50110ecacc41 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:45.680620 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-bf9aa3dc-3a5a-454b-9852-9be07dae0eb0 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:45.681296 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-bf9aa3dc-3a5a-454b-9852-9be07dae0eb0 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:45.701197 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bf9aa3dc-3a5a-454b-9852-9be07dae0eb0 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:45.701708 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bf9aa3dc-3a5a-454b-9852-9be07dae0eb0 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:45.702563 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bf9aa3dc-3a5a-454b-9852-9be07dae0eb0 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:45.703056 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bf9aa3dc-3a5a-454b-9852-9be07dae0eb0 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:45.898158 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d968cc3d-f777-459d-a9cc-50110ecacc41 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:45.909236 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d968cc3d-f777-459d-a9cc-50110ecacc41 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:45.911124 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d968cc3d-f777-459d-a9cc-50110ecacc41 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:45.912551 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d968cc3d-f777-459d-a9cc-50110ecacc41 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1754 microversion: 2.20 time: 0.322913 Apr 15 19:56:45.913658 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 290/665] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:45 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1754 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:56:45.920246 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-767b788c-062b-4bd1-884b-0fc5d421baf8 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:45.921081 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-767b788c-062b-4bd1-884b-0fc5d421baf8 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:45.929046 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-767b788c-062b-4bd1-884b-0fc5d421baf8 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:45.929529 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-767b788c-062b-4bd1-884b-0fc5d421baf8 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:45.930551 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-767b788c-062b-4bd1-884b-0fc5d421baf8 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:45.931039 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-767b788c-062b-4bd1-884b-0fc5d421baf8 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:45.986678 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-bf9aa3dc-3a5a-454b-9852-9be07dae0eb0 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:45.996204 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-bf9aa3dc-3a5a-454b-9852-9be07dae0eb0 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1721 microversion: 2.1 time: 0.319529 Apr 15 19:56:45.996983 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 376/666] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:45 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1721 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:46.149099 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-767b788c-062b-4bd1-884b-0fc5d421baf8 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:46.158654 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-767b788c-062b-4bd1-884b-0fc5d421baf8 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1261 microversion: 2.1 time: 0.243501 Apr 15 19:56:46.159306 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 291/667] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:45 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1261 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:46.932234 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-baac7d4b-5b40-40c0-bc34-4dbadf3e25c3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:46.932903 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-baac7d4b-5b40-40c0-bc34-4dbadf3e25c3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:46.941329 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-baac7d4b-5b40-40c0-bc34-4dbadf3e25c3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:46.941842 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-baac7d4b-5b40-40c0-bc34-4dbadf3e25c3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:46.942684 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-baac7d4b-5b40-40c0-bc34-4dbadf3e25c3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:46.943172 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-baac7d4b-5b40-40c0-bc34-4dbadf3e25c3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:47.014942 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6e19ecd3-a8c3-450c-8765-bde109587df1 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:47.015634 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6e19ecd3-a8c3-450c-8765-bde109587df1 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:47.023528 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6e19ecd3-a8c3-450c-8765-bde109587df1 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:47.024037 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6e19ecd3-a8c3-450c-8765-bde109587df1 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:47.024875 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6e19ecd3-a8c3-450c-8765-bde109587df1 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:47.025366 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6e19ecd3-a8c3-450c-8765-bde109587df1 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:47.209390 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-baac7d4b-5b40-40c0-bc34-4dbadf3e25c3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:47.219525 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-baac7d4b-5b40-40c0-bc34-4dbadf3e25c3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:47.221202 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-baac7d4b-5b40-40c0-bc34-4dbadf3e25c3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:47.222427 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-baac7d4b-5b40-40c0-bc34-4dbadf3e25c3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1754 microversion: 2.20 time: 0.294256 Apr 15 19:56:47.223041 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 377/668] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:46 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1754 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:56:47.227766 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9f8c0ab5-88bc-462e-bb79-2162dd8cf679 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:47.228434 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9f8c0ab5-88bc-462e-bb79-2162dd8cf679 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:47.236626 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9f8c0ab5-88bc-462e-bb79-2162dd8cf679 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:47.237141 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9f8c0ab5-88bc-462e-bb79-2162dd8cf679 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:47.237979 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9f8c0ab5-88bc-462e-bb79-2162dd8cf679 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:47.238510 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9f8c0ab5-88bc-462e-bb79-2162dd8cf679 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:47.285910 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-6e19ecd3-a8c3-450c-8765-bde109587df1 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:47.296533 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6e19ecd3-a8c3-450c-8765-bde109587df1 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1721 microversion: 2.1 time: 0.286374 Apr 15 19:56:47.297274 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 292/669] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:47 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1721 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:56:47.453655 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9f8c0ab5-88bc-462e-bb79-2162dd8cf679 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:47.462744 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9f8c0ab5-88bc-462e-bb79-2162dd8cf679 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1261 microversion: 2.1 time: 0.238653 Apr 15 19:56:47.463380 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 378/670] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:47 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1261 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:48.242435 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-dc67eea7-4064-4eb1-9921-ae059e8ec1f3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:48.243101 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-dc67eea7-4064-4eb1-9921-ae059e8ec1f3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:48.250932 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dc67eea7-4064-4eb1-9921-ae059e8ec1f3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:48.251467 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dc67eea7-4064-4eb1-9921-ae059e8ec1f3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:48.252301 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dc67eea7-4064-4eb1-9921-ae059e8ec1f3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:48.252789 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dc67eea7-4064-4eb1-9921-ae059e8ec1f3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:48.314644 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e6288252-f51a-41a0-866b-762339b9eb82 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:48.315442 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e6288252-f51a-41a0-866b-762339b9eb82 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:48.323907 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e6288252-f51a-41a0-866b-762339b9eb82 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:48.324619 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e6288252-f51a-41a0-866b-762339b9eb82 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:48.325674 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e6288252-f51a-41a0-866b-762339b9eb82 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:48.326319 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e6288252-f51a-41a0-866b-762339b9eb82 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:48.520926 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-dc67eea7-4064-4eb1-9921-ae059e8ec1f3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:48.533083 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-dc67eea7-4064-4eb1-9921-ae059e8ec1f3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:48.534752 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-dc67eea7-4064-4eb1-9921-ae059e8ec1f3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:48.536221 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-dc67eea7-4064-4eb1-9921-ae059e8ec1f3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1754 microversion: 2.20 time: 0.298087 Apr 15 19:56:48.536819 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 293/671] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:48 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1754 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:56:48.542609 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e741966a-f4ad-466e-8083-5460873b6093 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:48.543526 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e741966a-f4ad-466e-8083-5460873b6093 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:48.556157 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e741966a-f4ad-466e-8083-5460873b6093 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:48.556665 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e741966a-f4ad-466e-8083-5460873b6093 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:48.557504 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e741966a-f4ad-466e-8083-5460873b6093 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:48.557992 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e741966a-f4ad-466e-8083-5460873b6093 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:48.601098 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-e6288252-f51a-41a0-866b-762339b9eb82 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:48.611560 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e6288252-f51a-41a0-866b-762339b9eb82 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1721 microversion: 2.1 time: 0.301245 Apr 15 19:56:48.612288 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 379/672] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:48 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1721 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:48.775305 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-e741966a-f4ad-466e-8083-5460873b6093 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:48.784780 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e741966a-f4ad-466e-8083-5460873b6093 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1261 microversion: 2.1 time: 0.246680 Apr 15 19:56:48.785402 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 294/673] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:48 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1261 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:49.556265 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-cd7c93e8-b19b-4ada-b383-95a8c9032e0d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:49.556942 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-cd7c93e8-b19b-4ada-b383-95a8c9032e0d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:49.565295 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cd7c93e8-b19b-4ada-b383-95a8c9032e0d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:49.565808 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cd7c93e8-b19b-4ada-b383-95a8c9032e0d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:49.566648 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cd7c93e8-b19b-4ada-b383-95a8c9032e0d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:49.567142 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cd7c93e8-b19b-4ada-b383-95a8c9032e0d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:49.631741 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d352df42-9640-4f6f-bda4-9a9aeea33871 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:49.632267 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d352df42-9640-4f6f-bda4-9a9aeea33871 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:49.643922 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d352df42-9640-4f6f-bda4-9a9aeea33871 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:49.644432 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d352df42-9640-4f6f-bda4-9a9aeea33871 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:49.645276 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d352df42-9640-4f6f-bda4-9a9aeea33871 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:49.645772 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d352df42-9640-4f6f-bda4-9a9aeea33871 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:49.874301 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-cd7c93e8-b19b-4ada-b383-95a8c9032e0d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:49.884622 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-cd7c93e8-b19b-4ada-b383-95a8c9032e0d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:49.886296 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-cd7c93e8-b19b-4ada-b383-95a8c9032e0d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:49.887738 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-cd7c93e8-b19b-4ada-b383-95a8c9032e0d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1754 microversion: 2.20 time: 0.335355 Apr 15 19:56:49.888184 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 380/674] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:49 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1754 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:56:49.898639 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-87445ad5-7269-4c22-9e8c-39ead3548870 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:49.899482 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-87445ad5-7269-4c22-9e8c-39ead3548870 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:49.908235 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-87445ad5-7269-4c22-9e8c-39ead3548870 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:49.908837 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-87445ad5-7269-4c22-9e8c-39ead3548870 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:49.909843 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-87445ad5-7269-4c22-9e8c-39ead3548870 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:49.910561 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-87445ad5-7269-4c22-9e8c-39ead3548870 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:49.925051 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d352df42-9640-4f6f-bda4-9a9aeea33871 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:49.934844 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d352df42-9640-4f6f-bda4-9a9aeea33871 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1721 microversion: 2.1 time: 0.307631 Apr 15 19:56:49.935714 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 295/675] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:49 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1721 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:50.124106 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-87445ad5-7269-4c22-9e8c-39ead3548870 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:50.133008 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-87445ad5-7269-4c22-9e8c-39ead3548870 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1261 microversion: 2.1 time: 0.243803 Apr 15 19:56:50.133619 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 381/676] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:49 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1261 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:50.906588 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-99ca6807-fa64-478a-bcc9-749abc47ca97 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:50.907306 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-99ca6807-fa64-478a-bcc9-749abc47ca97 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:50.915308 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-99ca6807-fa64-478a-bcc9-749abc47ca97 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:50.916095 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-99ca6807-fa64-478a-bcc9-749abc47ca97 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:50.916941 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-99ca6807-fa64-478a-bcc9-749abc47ca97 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:50.917433 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-99ca6807-fa64-478a-bcc9-749abc47ca97 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:50.952993 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9c9c2654-d9c1-434f-bb0d-566995d6d888 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:50.953674 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9c9c2654-d9c1-434f-bb0d-566995d6d888 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:50.961497 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9c9c2654-d9c1-434f-bb0d-566995d6d888 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:50.962008 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9c9c2654-d9c1-434f-bb0d-566995d6d888 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:50.962845 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9c9c2654-d9c1-434f-bb0d-566995d6d888 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:50.963360 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9c9c2654-d9c1-434f-bb0d-566995d6d888 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:51.236532 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-99ca6807-fa64-478a-bcc9-749abc47ca97 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:51.240996 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9c9c2654-d9c1-434f-bb0d-566995d6d888 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:51.246637 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-99ca6807-fa64-478a-bcc9-749abc47ca97 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:51.248456 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-99ca6807-fa64-478a-bcc9-749abc47ca97 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:51.249713 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-99ca6807-fa64-478a-bcc9-749abc47ca97 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1754 microversion: 2.20 time: 0.347260 Apr 15 19:56:51.250325 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 296/677] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:50 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1754 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:56:51.250516 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9c9c2654-d9c1-434f-bb0d-566995d6d888 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1721 microversion: 2.1 time: 0.301541 Apr 15 19:56:51.255515 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 382/678] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:50 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1721 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:51.255669 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-2177eb42-1244-4de2-89cc-9954b686d5b2 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:51.255758 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-2177eb42-1244-4de2-89cc-9954b686d5b2 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:51.263206 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2177eb42-1244-4de2-89cc-9954b686d5b2 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:51.263743 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2177eb42-1244-4de2-89cc-9954b686d5b2 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:51.264575 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2177eb42-1244-4de2-89cc-9954b686d5b2 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:51.265068 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2177eb42-1244-4de2-89cc-9954b686d5b2 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:51.477318 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-2177eb42-1244-4de2-89cc-9954b686d5b2 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:51.486841 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-2177eb42-1244-4de2-89cc-9954b686d5b2 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1261 microversion: 2.1 time: 0.235502 Apr 15 19:56:51.487478 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 297/679] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:51 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1261 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:52.268639 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e6280621-6708-40cd-8fc1-93164b2ced8b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:52.269156 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6ed20fdc-508d-4580-b067-7712f27ad1ab tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:52.269290 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e6280621-6708-40cd-8fc1-93164b2ced8b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:52.269484 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6ed20fdc-508d-4580-b067-7712f27ad1ab tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:52.277302 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6ed20fdc-508d-4580-b067-7712f27ad1ab tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:52.277534 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e6280621-6708-40cd-8fc1-93164b2ced8b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:52.277809 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6ed20fdc-508d-4580-b067-7712f27ad1ab tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:52.278534 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e6280621-6708-40cd-8fc1-93164b2ced8b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:52.279162 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6ed20fdc-508d-4580-b067-7712f27ad1ab tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:52.279483 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e6280621-6708-40cd-8fc1-93164b2ced8b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:52.279853 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6ed20fdc-508d-4580-b067-7712f27ad1ab tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:52.279993 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e6280621-6708-40cd-8fc1-93164b2ced8b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:52.818881 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-e6280621-6708-40cd-8fc1-93164b2ced8b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:52.824006 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-6ed20fdc-508d-4580-b067-7712f27ad1ab tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:52.834084 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e6280621-6708-40cd-8fc1-93164b2ced8b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1721 microversion: 2.1 time: 0.569432 Apr 15 19:56:52.834929 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 383/680] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:52 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1721 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:52.841791 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-6ed20fdc-508d-4580-b067-7712f27ad1ab tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:52.843527 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-6ed20fdc-508d-4580-b067-7712f27ad1ab tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:52.844750 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6ed20fdc-508d-4580-b067-7712f27ad1ab tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1754 microversion: 2.20 time: 0.580067 Apr 15 19:56:52.845365 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 298/681] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:52 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1754 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 19:56:52.849319 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-faa87cc9-f565-4164-af4e-58650b6a166b tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:52.850410 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-faa87cc9-f565-4164-af4e-58650b6a166b tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:52.860064 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-faa87cc9-f565-4164-af4e-58650b6a166b tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:52.860580 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-faa87cc9-f565-4164-af4e-58650b6a166b tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:52.866564 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-faa87cc9-f565-4164-af4e-58650b6a166b tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:52.867084 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-faa87cc9-f565-4164-af4e-58650b6a166b tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:53.092641 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-faa87cc9-f565-4164-af4e-58650b6a166b tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:53.101509 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-faa87cc9-f565-4164-af4e-58650b6a166b tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1261 microversion: 2.1 time: 0.265746 Apr 15 19:56:53.102132 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 384/682] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:52 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1261 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:53.851616 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-13af053b-1994-4025-a784-69d7da7e1cd5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:53.852290 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-13af053b-1994-4025-a784-69d7da7e1cd5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:53.861299 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-13af053b-1994-4025-a784-69d7da7e1cd5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:53.861571 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-13af053b-1994-4025-a784-69d7da7e1cd5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:53.862414 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-13af053b-1994-4025-a784-69d7da7e1cd5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:53.862926 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-13af053b-1994-4025-a784-69d7da7e1cd5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:53.864804 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-5a1f0dba-397d-4ee5-a2f2-c794024a2a2a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:53.865629 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-5a1f0dba-397d-4ee5-a2f2-c794024a2a2a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:53.874942 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5a1f0dba-397d-4ee5-a2f2-c794024a2a2a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:53.875507 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5a1f0dba-397d-4ee5-a2f2-c794024a2a2a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:53.876457 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5a1f0dba-397d-4ee5-a2f2-c794024a2a2a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:53.876902 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5a1f0dba-397d-4ee5-a2f2-c794024a2a2a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:54.194050 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-13af053b-1994-4025-a784-69d7da7e1cd5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:54.198240 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-5a1f0dba-397d-4ee5-a2f2-c794024a2a2a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:54.203778 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-13af053b-1994-4025-a784-69d7da7e1cd5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1698 microversion: 2.1 time: 0.356011 Apr 15 19:56:54.204413 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 299/683] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:53 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1698 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:54.208912 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-5886ed2e-dc73-44c3-ae22-778f25dde21a tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:54.209569 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-5886ed2e-dc73-44c3-ae22-778f25dde21a tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:54.220976 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-5a1f0dba-397d-4ee5-a2f2-c794024a2a2a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:54.222074 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5886ed2e-dc73-44c3-ae22-778f25dde21a tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:54.222677 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5886ed2e-dc73-44c3-ae22-778f25dde21a tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:54.223644 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5886ed2e-dc73-44c3-ae22-778f25dde21a tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:54.224079 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-5a1f0dba-397d-4ee5-a2f2-c794024a2a2a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:54.224310 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5886ed2e-dc73-44c3-ae22-778f25dde21a tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:54.226243 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-5a1f0dba-397d-4ee5-a2f2-c794024a2a2a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1810 microversion: 2.20 time: 0.365699 Apr 15 19:56:54.227752 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 385/684] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:53 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1810 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 19:56:54.246628 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ff33e37f-aa85-49db-b968-de91b8bb1c10 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:56:54.257456 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ff33e37f-aa85-49db-b968-de91b8bb1c10 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:54.258179 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ff33e37f-aa85-49db-b968-de91b8bb1c10 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:54.342225 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ff33e37f-aa85-49db-b968-de91b8bb1c10 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Going to try to start instance {{(pid=99511) start /opt/stack/nova/nova/compute/api.py:2627}} Apr 15 19:56:54.443476 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ff33e37f-aa85-49db-b968-de91b8bb1c10 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 202 len: 0 microversion: 2.1 time: 0.199311 Apr 15 19:56:54.444640 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 386/685] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:56:54 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:56:54.454932 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9ea7c373-fc10-4ee7-bc93-9c9fef8a7642 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:54.455997 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9ea7c373-fc10-4ee7-bc93-9c9fef8a7642 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:54.464845 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9ea7c373-fc10-4ee7-bc93-9c9fef8a7642 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:54.465352 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9ea7c373-fc10-4ee7-bc93-9c9fef8a7642 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:54.466504 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9ea7c373-fc10-4ee7-bc93-9c9fef8a7642 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:54.466994 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9ea7c373-fc10-4ee7-bc93-9c9fef8a7642 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:54.651044 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-5886ed2e-dc73-44c3-ae22-778f25dde21a tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:54.660725 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-5886ed2e-dc73-44c3-ae22-778f25dde21a tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1261 microversion: 2.1 time: 0.455267 Apr 15 19:56:54.661282 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 300/686] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:54 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1261 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:54.807227 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9ea7c373-fc10-4ee7-bc93-9c9fef8a7642 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:54.817662 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9ea7c373-fc10-4ee7-bc93-9c9fef8a7642 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1707 microversion: 2.1 time: 0.368188 Apr 15 19:56:54.818341 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 387/687] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:54 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1707 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:55.247840 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-2bca89f1-ec3d-4921-94be-58ada37e650d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:55.249165 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-2bca89f1-ec3d-4921-94be-58ada37e650d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:55.276980 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2bca89f1-ec3d-4921-94be-58ada37e650d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:55.277486 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2bca89f1-ec3d-4921-94be-58ada37e650d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:55.278828 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2bca89f1-ec3d-4921-94be-58ada37e650d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:55.279323 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2bca89f1-ec3d-4921-94be-58ada37e650d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:55.517490 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-2bca89f1-ec3d-4921-94be-58ada37e650d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:55.529301 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-2bca89f1-ec3d-4921-94be-58ada37e650d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:55.531433 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-2bca89f1-ec3d-4921-94be-58ada37e650d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:55.532665 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-2bca89f1-ec3d-4921-94be-58ada37e650d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1810 microversion: 2.20 time: 0.289649 Apr 15 19:56:55.533265 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 301/688] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:55 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1810 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:56:55.679424 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-4568e323-9f08-4074-a414-3988081abfbc tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:55.680382 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-4568e323-9f08-4074-a414-3988081abfbc tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:55.690711 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4568e323-9f08-4074-a414-3988081abfbc tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:55.691333 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4568e323-9f08-4074-a414-3988081abfbc tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:55.693007 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4568e323-9f08-4074-a414-3988081abfbc tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:55.693656 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4568e323-9f08-4074-a414-3988081abfbc tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:55.840143 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a27a1f7c-f6ce-4463-8709-47eace0cee0a tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:55.840860 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a27a1f7c-f6ce-4463-8709-47eace0cee0a tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:55.850188 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a27a1f7c-f6ce-4463-8709-47eace0cee0a tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:55.850695 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a27a1f7c-f6ce-4463-8709-47eace0cee0a tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:55.851596 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a27a1f7c-f6ce-4463-8709-47eace0cee0a tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:55.852090 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a27a1f7c-f6ce-4463-8709-47eace0cee0a tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:56.027035 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-4568e323-9f08-4074-a414-3988081abfbc tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:56.042925 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-4568e323-9f08-4074-a414-3988081abfbc tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1261 microversion: 2.1 time: 0.367296 Apr 15 19:56:56.043647 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 388/689] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:55 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1261 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:56.132078 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a27a1f7c-f6ce-4463-8709-47eace0cee0a tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:56.147894 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a27a1f7c-f6ce-4463-8709-47eace0cee0a tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1707 microversion: 2.1 time: 0.311112 Apr 15 19:56:56.148824 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 302/690] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:55 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1707 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:56.552784 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-8260854c-3b0a-4140-828a-333e8ce0bc16 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:56.553449 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-8260854c-3b0a-4140-828a-333e8ce0bc16 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:56.561227 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8260854c-3b0a-4140-828a-333e8ce0bc16 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:56.561736 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8260854c-3b0a-4140-828a-333e8ce0bc16 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:56.562570 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8260854c-3b0a-4140-828a-333e8ce0bc16 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:56.563063 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8260854c-3b0a-4140-828a-333e8ce0bc16 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:56.777688 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-8260854c-3b0a-4140-828a-333e8ce0bc16 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:56.787757 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-8260854c-3b0a-4140-828a-333e8ce0bc16 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:56.789418 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-8260854c-3b0a-4140-828a-333e8ce0bc16 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:56.790886 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-8260854c-3b0a-4140-828a-333e8ce0bc16 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1810 microversion: 2.20 time: 0.241919 Apr 15 19:56:56.791514 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 389/691] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:56 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1810 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:56:57.062436 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ec627070-36c7-46de-9132-fd6efb094f76 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:57.063142 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ec627070-36c7-46de-9132-fd6efb094f76 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:57.071007 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ec627070-36c7-46de-9132-fd6efb094f76 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:57.071545 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ec627070-36c7-46de-9132-fd6efb094f76 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:57.072394 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ec627070-36c7-46de-9132-fd6efb094f76 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:57.072857 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ec627070-36c7-46de-9132-fd6efb094f76 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:57.169486 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-854ce5b7-15d9-4193-8a66-3c197bb6596b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:57.170157 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-854ce5b7-15d9-4193-8a66-3c197bb6596b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:57.178014 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-854ce5b7-15d9-4193-8a66-3c197bb6596b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:57.178512 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-854ce5b7-15d9-4193-8a66-3c197bb6596b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:57.179391 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-854ce5b7-15d9-4193-8a66-3c197bb6596b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:57.179890 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-854ce5b7-15d9-4193-8a66-3c197bb6596b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:57.357491 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ec627070-36c7-46de-9132-fd6efb094f76 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:57.366739 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ec627070-36c7-46de-9132-fd6efb094f76 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1261 microversion: 2.1 time: 0.308971 Apr 15 19:56:57.367509 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 303/692] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:57 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1261 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:57.439619 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-854ce5b7-15d9-4193-8a66-3c197bb6596b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:57.449267 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-854ce5b7-15d9-4193-8a66-3c197bb6596b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1707 microversion: 2.1 time: 0.284556 Apr 15 19:56:57.449931 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 390/693] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:57 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1707 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:56:57.810460 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-df8e5661-6a2f-4024-8424-0eee65ccbc65 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:57.811133 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-df8e5661-6a2f-4024-8424-0eee65ccbc65 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:57.819220 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-df8e5661-6a2f-4024-8424-0eee65ccbc65 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:57.819726 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-df8e5661-6a2f-4024-8424-0eee65ccbc65 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:57.820596 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-df8e5661-6a2f-4024-8424-0eee65ccbc65 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:57.821139 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-df8e5661-6a2f-4024-8424-0eee65ccbc65 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:58.041007 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-df8e5661-6a2f-4024-8424-0eee65ccbc65 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:58.051071 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-df8e5661-6a2f-4024-8424-0eee65ccbc65 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:58.052770 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-df8e5661-6a2f-4024-8424-0eee65ccbc65 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:58.053997 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-df8e5661-6a2f-4024-8424-0eee65ccbc65 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1810 microversion: 2.20 time: 0.247693 Apr 15 19:56:58.054795 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 304/694] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:57 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1810 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:56:58.384597 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-1ebd0f4a-d45a-48f7-9826-8507ec86c3b2 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:58.385272 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-1ebd0f4a-d45a-48f7-9826-8507ec86c3b2 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:58.393130 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1ebd0f4a-d45a-48f7-9826-8507ec86c3b2 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:58.393638 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1ebd0f4a-d45a-48f7-9826-8507ec86c3b2 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:58.394474 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1ebd0f4a-d45a-48f7-9826-8507ec86c3b2 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:58.394968 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1ebd0f4a-d45a-48f7-9826-8507ec86c3b2 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:58.471813 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a3a202e3-6605-470c-8eba-aa6cd7130470 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:58.471813 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a3a202e3-6605-470c-8eba-aa6cd7130470 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:58.476909 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a3a202e3-6605-470c-8eba-aa6cd7130470 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:58.477420 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a3a202e3-6605-470c-8eba-aa6cd7130470 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:58.478262 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a3a202e3-6605-470c-8eba-aa6cd7130470 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:58.478757 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a3a202e3-6605-470c-8eba-aa6cd7130470 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:58.660935 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-1ebd0f4a-d45a-48f7-9826-8507ec86c3b2 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:58.671593 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-1ebd0f4a-d45a-48f7-9826-8507ec86c3b2 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1261 microversion: 2.1 time: 0.291005 Apr 15 19:56:58.682591 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 391/695] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:58 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1261 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:58.743491 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a3a202e3-6605-470c-8eba-aa6cd7130470 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:58.753154 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a3a202e3-6605-470c-8eba-aa6cd7130470 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1707 microversion: 2.1 time: 0.289106 Apr 15 19:56:58.753789 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 305/696] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:58 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1707 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:56:59.073870 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-164f7184-b7f4-4dcf-a6b1-c01fea4b42d7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:59.074531 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-164f7184-b7f4-4dcf-a6b1-c01fea4b42d7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:59.083707 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-164f7184-b7f4-4dcf-a6b1-c01fea4b42d7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:59.084222 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-164f7184-b7f4-4dcf-a6b1-c01fea4b42d7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:59.085066 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-164f7184-b7f4-4dcf-a6b1-c01fea4b42d7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:59.085557 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-164f7184-b7f4-4dcf-a6b1-c01fea4b42d7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:59.304943 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-164f7184-b7f4-4dcf-a6b1-c01fea4b42d7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:59.315591 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-164f7184-b7f4-4dcf-a6b1-c01fea4b42d7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:59.317282 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-164f7184-b7f4-4dcf-a6b1-c01fea4b42d7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:59.318533 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-164f7184-b7f4-4dcf-a6b1-c01fea4b42d7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1810 microversion: 2.20 time: 0.248883 Apr 15 19:56:59.319152 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 392/697] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:56:59 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1810 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:56:59.689857 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-693723d3-23ef-4d8c-adc6-70bbbfdfe073 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:59.690578 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-693723d3-23ef-4d8c-adc6-70bbbfdfe073 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:59.698471 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-693723d3-23ef-4d8c-adc6-70bbbfdfe073 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:59.698975 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-693723d3-23ef-4d8c-adc6-70bbbfdfe073 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:59.700521 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-693723d3-23ef-4d8c-adc6-70bbbfdfe073 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:59.701216 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-693723d3-23ef-4d8c-adc6-70bbbfdfe073 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:59.771693 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-69ade484-c6cb-49d8-8d11-5cefbb7da174 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:56:59.772640 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-69ade484-c6cb-49d8-8d11-5cefbb7da174 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:56:59.782408 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-69ade484-c6cb-49d8-8d11-5cefbb7da174 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:59.783195 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-69ade484-c6cb-49d8-8d11-5cefbb7da174 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:59.784740 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-69ade484-c6cb-49d8-8d11-5cefbb7da174 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:56:59.785426 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-69ade484-c6cb-49d8-8d11-5cefbb7da174 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:56:59.985554 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-693723d3-23ef-4d8c-adc6-70bbbfdfe073 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:56:59.999624 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-693723d3-23ef-4d8c-adc6-70bbbfdfe073 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1261 microversion: 2.1 time: 0.313616 Apr 15 19:57:00.002716 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 306/698] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:59 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1261 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:57:00.077121 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-69ade484-c6cb-49d8-8d11-5cefbb7da174 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:00.087448 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-69ade484-c6cb-49d8-8d11-5cefbb7da174 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1707 microversion: 2.1 time: 0.319915 Apr 15 19:57:00.088351 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 393/699] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:56:59 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1707 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:57:00.337470 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-fb4430c1-33d3-466a-8ab5-5617059e78c2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:00.338144 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-fb4430c1-33d3-466a-8ab5-5617059e78c2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:00.346557 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fb4430c1-33d3-466a-8ab5-5617059e78c2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:00.347069 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fb4430c1-33d3-466a-8ab5-5617059e78c2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:00.347930 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fb4430c1-33d3-466a-8ab5-5617059e78c2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:00.348428 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fb4430c1-33d3-466a-8ab5-5617059e78c2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:00.566605 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-fb4430c1-33d3-466a-8ab5-5617059e78c2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:00.577200 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-fb4430c1-33d3-466a-8ab5-5617059e78c2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:00.578872 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-fb4430c1-33d3-466a-8ab5-5617059e78c2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:00.580135 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-fb4430c1-33d3-466a-8ab5-5617059e78c2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1810 microversion: 2.20 time: 0.246765 Apr 15 19:57:00.580746 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 307/700] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:57:00 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1810 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 19:57:01.018109 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-41cba0fe-d89e-4dc9-8b49-4177d36a4884 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:01.018780 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-41cba0fe-d89e-4dc9-8b49-4177d36a4884 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:01.026555 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-41cba0fe-d89e-4dc9-8b49-4177d36a4884 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:01.027061 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-41cba0fe-d89e-4dc9-8b49-4177d36a4884 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:01.027940 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-41cba0fe-d89e-4dc9-8b49-4177d36a4884 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:01.028428 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-41cba0fe-d89e-4dc9-8b49-4177d36a4884 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:01.105665 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b87676a2-879a-40ad-bf35-124b42272139 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:01.106390 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b87676a2-879a-40ad-bf35-124b42272139 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:01.114318 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b87676a2-879a-40ad-bf35-124b42272139 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:01.114823 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b87676a2-879a-40ad-bf35-124b42272139 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:01.115682 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b87676a2-879a-40ad-bf35-124b42272139 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:01.116174 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b87676a2-879a-40ad-bf35-124b42272139 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:01.297735 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-41cba0fe-d89e-4dc9-8b49-4177d36a4884 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:01.306831 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-41cba0fe-d89e-4dc9-8b49-4177d36a4884 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1261 microversion: 2.1 time: 0.292715 Apr 15 19:57:01.307550 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 394/701] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:01 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1261 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:57:01.373264 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b87676a2-879a-40ad-bf35-124b42272139 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:01.382949 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b87676a2-879a-40ad-bf35-124b42272139 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1707 microversion: 2.1 time: 0.281137 Apr 15 19:57:01.383624 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 308/702] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:01 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1707 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:57:01.600353 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-48bd85ff-79f5-4f53-9acb-8ca06df2559e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:01.601035 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-48bd85ff-79f5-4f53-9acb-8ca06df2559e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:01.609599 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-48bd85ff-79f5-4f53-9acb-8ca06df2559e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:01.610116 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-48bd85ff-79f5-4f53-9acb-8ca06df2559e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:01.610961 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-48bd85ff-79f5-4f53-9acb-8ca06df2559e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:01.611525 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-48bd85ff-79f5-4f53-9acb-8ca06df2559e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:01.828280 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-48bd85ff-79f5-4f53-9acb-8ca06df2559e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:01.838485 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-48bd85ff-79f5-4f53-9acb-8ca06df2559e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:01.840185 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-48bd85ff-79f5-4f53-9acb-8ca06df2559e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:01.841931 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-48bd85ff-79f5-4f53-9acb-8ca06df2559e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1810 microversion: 2.20 time: 0.245877 Apr 15 19:57:01.842544 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 395/703] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:57:01 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1810 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:57:02.326246 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-8c677051-03bb-440c-adfc-a6acf7567808 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:02.326952 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-8c677051-03bb-440c-adfc-a6acf7567808 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:02.334942 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8c677051-03bb-440c-adfc-a6acf7567808 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:02.335526 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8c677051-03bb-440c-adfc-a6acf7567808 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:02.336356 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8c677051-03bb-440c-adfc-a6acf7567808 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:02.336847 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8c677051-03bb-440c-adfc-a6acf7567808 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:02.401388 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-104ac3cb-7a4b-4164-b42e-5eaf379d1910 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:02.402067 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-104ac3cb-7a4b-4164-b42e-5eaf379d1910 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:02.414599 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-104ac3cb-7a4b-4164-b42e-5eaf379d1910 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:02.415139 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-104ac3cb-7a4b-4164-b42e-5eaf379d1910 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:02.416315 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-104ac3cb-7a4b-4164-b42e-5eaf379d1910 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:02.416806 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-104ac3cb-7a4b-4164-b42e-5eaf379d1910 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:02.680833 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-8c677051-03bb-440c-adfc-a6acf7567808 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:02.690934 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-8c677051-03bb-440c-adfc-a6acf7567808 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1261 microversion: 2.1 time: 0.369328 Apr 15 19:57:02.691784 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 309/704] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:02 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1261 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:57:02.712293 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-104ac3cb-7a4b-4164-b42e-5eaf379d1910 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:02.723615 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-104ac3cb-7a4b-4164-b42e-5eaf379d1910 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1707 microversion: 2.1 time: 0.326191 Apr 15 19:57:02.724344 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 396/705] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:02 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1707 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:57:02.861686 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c3c5ee36-e5ae-4a58-8c25-787c5e0911b5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:02.862581 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c3c5ee36-e5ae-4a58-8c25-787c5e0911b5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:02.871844 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c3c5ee36-e5ae-4a58-8c25-787c5e0911b5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:02.872627 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c3c5ee36-e5ae-4a58-8c25-787c5e0911b5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:02.873391 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c3c5ee36-e5ae-4a58-8c25-787c5e0911b5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:02.873805 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c3c5ee36-e5ae-4a58-8c25-787c5e0911b5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:03.103968 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c3c5ee36-e5ae-4a58-8c25-787c5e0911b5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:03.114904 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c3c5ee36-e5ae-4a58-8c25-787c5e0911b5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:03.116905 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c3c5ee36-e5ae-4a58-8c25-787c5e0911b5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:03.117832 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c3c5ee36-e5ae-4a58-8c25-787c5e0911b5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1810 microversion: 2.20 time: 0.260339 Apr 15 19:57:03.139873 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 310/706] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:57:02 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1810 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 19:57:03.709903 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7c791de0-a615-4cff-9f63-25815fddd5d5 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:03.710572 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7c791de0-a615-4cff-9f63-25815fddd5d5 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:03.718966 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7c791de0-a615-4cff-9f63-25815fddd5d5 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:03.719507 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7c791de0-a615-4cff-9f63-25815fddd5d5 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:03.720341 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7c791de0-a615-4cff-9f63-25815fddd5d5 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:03.720831 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7c791de0-a615-4cff-9f63-25815fddd5d5 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:03.742191 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-826fd707-308e-4db2-bbb9-85ef5af51302 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:03.742866 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-826fd707-308e-4db2-bbb9-85ef5af51302 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:03.750816 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-826fd707-308e-4db2-bbb9-85ef5af51302 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:03.751353 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-826fd707-308e-4db2-bbb9-85ef5af51302 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:03.752196 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-826fd707-308e-4db2-bbb9-85ef5af51302 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:03.752694 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-826fd707-308e-4db2-bbb9-85ef5af51302 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:04.042399 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-7c791de0-a615-4cff-9f63-25815fddd5d5 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:04.048252 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-826fd707-308e-4db2-bbb9-85ef5af51302 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:04.057365 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7c791de0-a615-4cff-9f63-25815fddd5d5 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1261 microversion: 2.1 time: 0.351326 Apr 15 19:57:04.058704 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 397/707] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:03 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1261 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:57:04.059782 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-826fd707-308e-4db2-bbb9-85ef5af51302 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1707 microversion: 2.1 time: 0.320759 Apr 15 19:57:04.067454 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 311/708] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:03 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1707 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:57:04.331963 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-1ac543ea-e3dc-4978-b198-6fd7590625c6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:04.333032 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-1ac543ea-e3dc-4978-b198-6fd7590625c6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:04.341252 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1ac543ea-e3dc-4978-b198-6fd7590625c6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:04.341771 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1ac543ea-e3dc-4978-b198-6fd7590625c6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:04.342678 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1ac543ea-e3dc-4978-b198-6fd7590625c6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:04.343173 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1ac543ea-e3dc-4978-b198-6fd7590625c6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:04.572263 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-1ac543ea-e3dc-4978-b198-6fd7590625c6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:04.582674 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-1ac543ea-e3dc-4978-b198-6fd7590625c6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:04.584402 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-1ac543ea-e3dc-4978-b198-6fd7590625c6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:04.585649 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-1ac543ea-e3dc-4978-b198-6fd7590625c6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1810 microversion: 2.20 time: 0.443158 Apr 15 19:57:04.586370 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 398/709] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:57:04 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1810 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:57:05.075669 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9a0f3a38-12f8-42a6-9689-af5a23706e9e tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:05.076342 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9a0f3a38-12f8-42a6-9689-af5a23706e9e tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:05.078477 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-8ef07292-6210-4e55-a4d8-623397b2a43c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:05.079157 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-8ef07292-6210-4e55-a4d8-623397b2a43c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:05.084428 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9a0f3a38-12f8-42a6-9689-af5a23706e9e tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:05.084954 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9a0f3a38-12f8-42a6-9689-af5a23706e9e tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:05.085814 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9a0f3a38-12f8-42a6-9689-af5a23706e9e tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:05.086312 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9a0f3a38-12f8-42a6-9689-af5a23706e9e tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:05.088369 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8ef07292-6210-4e55-a4d8-623397b2a43c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:05.088887 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8ef07292-6210-4e55-a4d8-623397b2a43c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:05.089742 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8ef07292-6210-4e55-a4d8-623397b2a43c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:05.090245 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8ef07292-6210-4e55-a4d8-623397b2a43c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:05.393314 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-8ef07292-6210-4e55-a4d8-623397b2a43c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:05.405660 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-8ef07292-6210-4e55-a4d8-623397b2a43c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1707 microversion: 2.1 time: 0.331710 Apr 15 19:57:05.406701 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 399/710] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:05 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1707 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:57:05.443730 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9a0f3a38-12f8-42a6-9689-af5a23706e9e tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:05.452774 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9a0f3a38-12f8-42a6-9689-af5a23706e9e tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1261 microversion: 2.1 time: 0.381889 Apr 15 19:57:05.453634 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 312/711] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:05 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1261 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:57:05.605439 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-854c5016-2f46-4ad6-b87b-2daf071e104c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:05.606775 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-854c5016-2f46-4ad6-b87b-2daf071e104c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:05.615744 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-854c5016-2f46-4ad6-b87b-2daf071e104c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:05.616341 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-854c5016-2f46-4ad6-b87b-2daf071e104c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:05.617640 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-854c5016-2f46-4ad6-b87b-2daf071e104c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:05.618241 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-854c5016-2f46-4ad6-b87b-2daf071e104c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:05.853578 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-854c5016-2f46-4ad6-b87b-2daf071e104c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:05.864078 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-854c5016-2f46-4ad6-b87b-2daf071e104c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:05.865692 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-854c5016-2f46-4ad6-b87b-2daf071e104c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:05.866925 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-854c5016-2f46-4ad6-b87b-2daf071e104c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1810 microversion: 2.20 time: 0.265935 Apr 15 19:57:05.867787 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 400/712] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:57:05 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1810 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:57:06.424382 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-bde727de-efe5-4231-94d3-a56a0b2bfe79 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:06.425135 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-bde727de-efe5-4231-94d3-a56a0b2bfe79 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:06.433188 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bde727de-efe5-4231-94d3-a56a0b2bfe79 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:06.433795 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bde727de-efe5-4231-94d3-a56a0b2bfe79 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:06.435135 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bde727de-efe5-4231-94d3-a56a0b2bfe79 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:06.435658 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bde727de-efe5-4231-94d3-a56a0b2bfe79 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:06.473467 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-8e3454fb-9e02-43ac-86d6-3b69970ecc86 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:06.474144 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-8e3454fb-9e02-43ac-86d6-3b69970ecc86 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:06.482026 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8e3454fb-9e02-43ac-86d6-3b69970ecc86 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:06.482533 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8e3454fb-9e02-43ac-86d6-3b69970ecc86 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:06.484021 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8e3454fb-9e02-43ac-86d6-3b69970ecc86 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:06.484021 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8e3454fb-9e02-43ac-86d6-3b69970ecc86 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:06.772246 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-bde727de-efe5-4231-94d3-a56a0b2bfe79 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:06.779974 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-8e3454fb-9e02-43ac-86d6-3b69970ecc86 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:06.782286 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-bde727de-efe5-4231-94d3-a56a0b2bfe79 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1707 microversion: 2.1 time: 0.362150 Apr 15 19:57:06.782921 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 313/713] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:06 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1707 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:57:06.788871 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-8e3454fb-9e02-43ac-86d6-3b69970ecc86 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1261 microversion: 2.1 time: 0.321599 Apr 15 19:57:06.789488 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 401/714] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:06 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1261 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:57:06.887061 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-53561d41-0db1-4c12-8f13-0e91c336fd52 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:06.888580 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-53561d41-0db1-4c12-8f13-0e91c336fd52 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:06.896473 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-53561d41-0db1-4c12-8f13-0e91c336fd52 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:06.896980 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-53561d41-0db1-4c12-8f13-0e91c336fd52 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:06.897821 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-53561d41-0db1-4c12-8f13-0e91c336fd52 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:06.898336 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-53561d41-0db1-4c12-8f13-0e91c336fd52 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:07.114609 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-53561d41-0db1-4c12-8f13-0e91c336fd52 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:07.124938 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-53561d41-0db1-4c12-8f13-0e91c336fd52 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:07.126599 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-53561d41-0db1-4c12-8f13-0e91c336fd52 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:07.127890 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-53561d41-0db1-4c12-8f13-0e91c336fd52 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1810 microversion: 2.20 time: 0.244941 Apr 15 19:57:07.128503 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 314/715] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:57:06 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1810 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:57:07.800982 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b94ccafc-757f-44a9-b9a2-65f88bdab620 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:07.801666 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b94ccafc-757f-44a9-b9a2-65f88bdab620 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:07.806540 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-3674e51d-e359-4569-88bb-72751331569e tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:07.807611 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-3674e51d-e359-4569-88bb-72751331569e tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:07.810378 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b94ccafc-757f-44a9-b9a2-65f88bdab620 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:07.810889 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b94ccafc-757f-44a9-b9a2-65f88bdab620 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:07.811754 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b94ccafc-757f-44a9-b9a2-65f88bdab620 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:07.812429 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b94ccafc-757f-44a9-b9a2-65f88bdab620 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:07.816894 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3674e51d-e359-4569-88bb-72751331569e tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:07.817518 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3674e51d-e359-4569-88bb-72751331569e tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:07.818553 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3674e51d-e359-4569-88bb-72751331569e tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:07.819045 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3674e51d-e359-4569-88bb-72751331569e tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:08.041446 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b94ccafc-757f-44a9-b9a2-65f88bdab620 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:08.051563 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b94ccafc-757f-44a9-b9a2-65f88bdab620 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1707 microversion: 2.1 time: 0.254636 Apr 15 19:57:08.052190 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 402/716] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:07 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1707 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:57:08.146131 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ea76c7cd-8d4e-47c2-8c20-25fb7051c948 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:08.146805 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ea76c7cd-8d4e-47c2-8c20-25fb7051c948 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:08.154705 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ea76c7cd-8d4e-47c2-8c20-25fb7051c948 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:08.155215 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ea76c7cd-8d4e-47c2-8c20-25fb7051c948 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:08.156147 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ea76c7cd-8d4e-47c2-8c20-25fb7051c948 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:08.156731 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ea76c7cd-8d4e-47c2-8c20-25fb7051c948 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:08.181839 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3674e51d-e359-4569-88bb-72751331569e tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:08.191600 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-3674e51d-e359-4569-88bb-72751331569e tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1261 microversion: 2.1 time: 0.389406 Apr 15 19:57:08.192223 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 315/717] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:07 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1261 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:57:08.368010 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ea76c7cd-8d4e-47c2-8c20-25fb7051c948 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:08.378632 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ea76c7cd-8d4e-47c2-8c20-25fb7051c948 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:08.380322 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ea76c7cd-8d4e-47c2-8c20-25fb7051c948 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:08.381525 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ea76c7cd-8d4e-47c2-8c20-25fb7051c948 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1810 microversion: 2.20 time: 0.239475 Apr 15 19:57:08.382136 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 403/718] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:57:08 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1810 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 19:57:09.070505 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-fc71eaf5-1d88-4025-87d2-a3e1f3af138f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:09.071182 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-fc71eaf5-1d88-4025-87d2-a3e1f3af138f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:09.079259 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fc71eaf5-1d88-4025-87d2-a3e1f3af138f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:09.079816 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fc71eaf5-1d88-4025-87d2-a3e1f3af138f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:09.080660 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fc71eaf5-1d88-4025-87d2-a3e1f3af138f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:09.081548 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fc71eaf5-1d88-4025-87d2-a3e1f3af138f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:09.212151 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-28989196-98d9-4cf6-8490-45ee4d975131 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:09.212840 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-28989196-98d9-4cf6-8490-45ee4d975131 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:09.221430 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-28989196-98d9-4cf6-8490-45ee4d975131 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:09.222268 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-28989196-98d9-4cf6-8490-45ee4d975131 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:09.223414 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-28989196-98d9-4cf6-8490-45ee4d975131 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:09.224007 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-28989196-98d9-4cf6-8490-45ee4d975131 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:09.307844 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-fc71eaf5-1d88-4025-87d2-a3e1f3af138f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:09.317581 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-fc71eaf5-1d88-4025-87d2-a3e1f3af138f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1707 microversion: 2.1 time: 0.251092 Apr 15 19:57:09.318287 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 316/719] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:09 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1707 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:57:09.400773 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f77be522-1103-43c2-95a9-60cc03b6e23a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:09.401939 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f77be522-1103-43c2-95a9-60cc03b6e23a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:09.419917 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f77be522-1103-43c2-95a9-60cc03b6e23a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:09.420704 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f77be522-1103-43c2-95a9-60cc03b6e23a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:09.421575 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f77be522-1103-43c2-95a9-60cc03b6e23a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:09.422070 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f77be522-1103-43c2-95a9-60cc03b6e23a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:09.449464 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-28989196-98d9-4cf6-8490-45ee4d975131 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:09.458963 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-28989196-98d9-4cf6-8490-45ee4d975131 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1261 microversion: 2.1 time: 0.252491 Apr 15 19:57:09.463521 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 404/720] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:09 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1261 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:57:09.643931 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f77be522-1103-43c2-95a9-60cc03b6e23a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:09.655147 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f77be522-1103-43c2-95a9-60cc03b6e23a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:09.656863 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f77be522-1103-43c2-95a9-60cc03b6e23a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:09.658089 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f77be522-1103-43c2-95a9-60cc03b6e23a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1810 microversion: 2.20 time: 0.261430 Apr 15 19:57:09.658695 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 317/721] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:57:09 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1810 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 19:57:10.336589 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-5ae15c57-b1d3-4c12-b816-307ec0250cc6 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:10.337565 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-5ae15c57-b1d3-4c12-b816-307ec0250cc6 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:10.353422 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5ae15c57-b1d3-4c12-b816-307ec0250cc6 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:10.354035 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5ae15c57-b1d3-4c12-b816-307ec0250cc6 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:10.354986 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5ae15c57-b1d3-4c12-b816-307ec0250cc6 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:10.355542 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5ae15c57-b1d3-4c12-b816-307ec0250cc6 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:10.476835 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e0373a5c-562c-4877-bff6-0fcf35641b3d tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:10.477637 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e0373a5c-562c-4877-bff6-0fcf35641b3d tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:10.485946 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e0373a5c-562c-4877-bff6-0fcf35641b3d tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:10.486462 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e0373a5c-562c-4877-bff6-0fcf35641b3d tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:10.487341 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e0373a5c-562c-4877-bff6-0fcf35641b3d tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:10.487936 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e0373a5c-562c-4877-bff6-0fcf35641b3d tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:10.876330 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-5ae15c57-b1d3-4c12-b816-307ec0250cc6 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:10.890160 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-5ae15c57-b1d3-4c12-b816-307ec0250cc6 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1707 microversion: 2.1 time: 0.558578 Apr 15 19:57:10.891135 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 405/722] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:10 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1707 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:57:10.896967 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-2c439790-99db-4291-a8c2-e6ab6fb95cfb tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:10.897884 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-2c439790-99db-4291-a8c2-e6ab6fb95cfb tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:10.907847 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2c439790-99db-4291-a8c2-e6ab6fb95cfb tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:10.909251 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2c439790-99db-4291-a8c2-e6ab6fb95cfb tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:10.917276 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2c439790-99db-4291-a8c2-e6ab6fb95cfb tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:10.917872 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2c439790-99db-4291-a8c2-e6ab6fb95cfb tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:10.974354 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-e0373a5c-562c-4877-bff6-0fcf35641b3d tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:10.983610 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e0373a5c-562c-4877-bff6-0fcf35641b3d tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1261 microversion: 2.1 time: 0.510731 Apr 15 19:57:10.984228 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 318/723] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:10 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1261 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:57:11.142571 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-2c439790-99db-4291-a8c2-e6ab6fb95cfb tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:11.152663 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-2c439790-99db-4291-a8c2-e6ab6fb95cfb tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:11.154966 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-2c439790-99db-4291-a8c2-e6ab6fb95cfb tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:11.156209 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-2c439790-99db-4291-a8c2-e6ab6fb95cfb tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1810 microversion: 2.20 time: 0.263695 Apr 15 19:57:11.156816 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 406/724] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:57:10 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1810 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:57:11.467886 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-a7ed9485-751b-45ae-bb1a-58df87fd63fd req-e79aec4a-519f-443c-8953-b33edb12380b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c241efcb-ba90-43dd-a6c3-393b77086172", "name": "network-vif-plugged", "status": "completed", "tag": "32a87087-67a6-454d-8830-c295f0d8e889"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:57:11.469823 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:57:11.469823 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:57:11.478937 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-a7ed9485-751b-45ae-bb1a-58df87fd63fd req-e79aec4a-519f-443c-8953-b33edb12380b service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:11.479466 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-a7ed9485-751b-45ae-bb1a-58df87fd63fd req-e79aec4a-519f-443c-8953-b33edb12380b service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:11.497886 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-a7ed9485-751b-45ae-bb1a-58df87fd63fd req-e79aec4a-519f-443c-8953-b33edb12380b service nova] Creating event network-vif-plugged:32a87087-67a6-454d-8830-c295f0d8e889 for instance c241efcb-ba90-43dd-a6c3-393b77086172 on hv-cinder-78638 Apr 15 19:57:11.504878 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-a7ed9485-751b-45ae-bb1a-58df87fd63fd req-e79aec4a-519f-443c-8953-b33edb12380b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048896 Apr 15 19:57:11.505512 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 319/725] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:57:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:57:11.909379 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ca8139fc-92da-455e-92f4-fa25f452833c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:11.910269 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ca8139fc-92da-455e-92f4-fa25f452833c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:11.924654 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ca8139fc-92da-455e-92f4-fa25f452833c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:11.925224 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ca8139fc-92da-455e-92f4-fa25f452833c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:11.926311 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ca8139fc-92da-455e-92f4-fa25f452833c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:11.927006 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ca8139fc-92da-455e-92f4-fa25f452833c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:12.003529 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-59be9b86-364e-48cc-aaf0-ca94070c6fe7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:12.004312 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-59be9b86-364e-48cc-aaf0-ca94070c6fe7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:12.012796 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-59be9b86-364e-48cc-aaf0-ca94070c6fe7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:12.013679 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-59be9b86-364e-48cc-aaf0-ca94070c6fe7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:12.014763 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-59be9b86-364e-48cc-aaf0-ca94070c6fe7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:12.015713 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-59be9b86-364e-48cc-aaf0-ca94070c6fe7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:12.221436 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ca8139fc-92da-455e-92f4-fa25f452833c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:12.233108 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ca8139fc-92da-455e-92f4-fa25f452833c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1707 microversion: 2.1 time: 0.327972 Apr 15 19:57:12.235310 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 407/726] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:11 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1707 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:57:12.241693 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c2b73826-ae61-4f77-a84b-88059cfff831 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:12.242670 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c2b73826-ae61-4f77-a84b-88059cfff831 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:12.252063 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c2b73826-ae61-4f77-a84b-88059cfff831 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:12.252598 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c2b73826-ae61-4f77-a84b-88059cfff831 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:12.253452 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c2b73826-ae61-4f77-a84b-88059cfff831 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:12.253836 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c2b73826-ae61-4f77-a84b-88059cfff831 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:12.312507 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-59be9b86-364e-48cc-aaf0-ca94070c6fe7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:12.321848 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-59be9b86-364e-48cc-aaf0-ca94070c6fe7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1261 microversion: 2.1 time: 0.322778 Apr 15 19:57:12.322867 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 320/727] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:11 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1261 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:57:12.484958 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c2b73826-ae61-4f77-a84b-88059cfff831 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:12.495072 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c2b73826-ae61-4f77-a84b-88059cfff831 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:12.496808 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c2b73826-ae61-4f77-a84b-88059cfff831 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:12.498129 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c2b73826-ae61-4f77-a84b-88059cfff831 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1810 microversion: 2.20 time: 0.260923 Apr 15 19:57:12.498750 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 408/728] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:57:12 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1810 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:57:13.061934 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-92f54024-f117-4413-bea7-ab488cd9aaff tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:13.062493 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-92f54024-f117-4413-bea7-ab488cd9aaff tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: a5f4046a-6bc2-4099-afa3-c1a2d16c38f0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:13.070331 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-92f54024-f117-4413-bea7-ab488cd9aaff tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:13.070845 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-92f54024-f117-4413-bea7-ab488cd9aaff tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:13.071711 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-92f54024-f117-4413-bea7-ab488cd9aaff tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:13.072212 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-92f54024-f117-4413-bea7-ab488cd9aaff tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:13.247855 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.objects.instance [None req-92f54024-f117-4413-bea7-ab488cd9aaff tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lazy-loading 'services' on Instance uuid a5f4046a-6bc2-4099-afa3-c1a2d16c38f0 {{(pid=99512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 15 19:57:13.254700 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9e58149e-3f9e-40ab-901b-259f020ce8fb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:13.255397 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9e58149e-3f9e-40ab-901b-259f020ce8fb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:13.263740 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9e58149e-3f9e-40ab-901b-259f020ce8fb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:13.264242 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9e58149e-3f9e-40ab-901b-259f020ce8fb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:13.265068 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9e58149e-3f9e-40ab-901b-259f020ce8fb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:13.265560 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9e58149e-3f9e-40ab-901b-259f020ce8fb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:13.403071 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-92f54024-f117-4413-bea7-ab488cd9aaff tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0/os-volume_attachments/4c84dba5-4aeb-41d9-8405-d5b7ca419455" status: 202 len: 0 microversion: 2.1 time: 0.345459 Apr 15 19:57:13.403676 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 321/729] 10.222.0.58 () {58 vars in 1406 bytes} [Thu Apr 15 19:57:13 2021] DELETE /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0/os-volume_attachments/4c84dba5-4aeb-41d9-8405-d5b7ca419455 => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:57:13.409562 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-15e0c973-2065-4ce8-8c60-d3363852ba02 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:13.410429 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-15e0c973-2065-4ce8-8c60-d3363852ba02 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:13.418687 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-15e0c973-2065-4ce8-8c60-d3363852ba02 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:13.419752 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-15e0c973-2065-4ce8-8c60-d3363852ba02 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:13.420816 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-15e0c973-2065-4ce8-8c60-d3363852ba02 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:13.421314 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-15e0c973-2065-4ce8-8c60-d3363852ba02 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:13.519424 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9e58149e-3f9e-40ab-901b-259f020ce8fb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:13.543714 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9e58149e-3f9e-40ab-901b-259f020ce8fb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1707 microversion: 2.1 time: 0.292768 Apr 15 19:57:13.551991 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 409/730] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:13 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1707 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:57:13.557268 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-81f01ce0-845a-4293-9437-c310cbb1e02f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:13.557938 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-81f01ce0-845a-4293-9437-c310cbb1e02f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:13.578379 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-81f01ce0-845a-4293-9437-c310cbb1e02f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:13.580945 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-81f01ce0-845a-4293-9437-c310cbb1e02f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:13.581881 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-81f01ce0-845a-4293-9437-c310cbb1e02f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:13.582385 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-81f01ce0-845a-4293-9437-c310cbb1e02f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:13.830800 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-15e0c973-2065-4ce8-8c60-d3363852ba02 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:13.841129 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-15e0c973-2065-4ce8-8c60-d3363852ba02 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1261 microversion: 2.1 time: 0.435474 Apr 15 19:57:13.842141 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 322/731] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:13 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1261 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:57:13.985537 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-81f01ce0-845a-4293-9437-c310cbb1e02f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:13.995930 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-81f01ce0-845a-4293-9437-c310cbb1e02f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:13.998166 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-81f01ce0-845a-4293-9437-c310cbb1e02f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:13.999471 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-81f01ce0-845a-4293-9437-c310cbb1e02f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1810 microversion: 2.20 time: 0.446399 Apr 15 19:57:14.000100 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 410/732] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:57:13 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1810 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:57:14.570138 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-fb0f4ed1-f5cb-4335-9cf2-1386bbfc5a72 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:14.570963 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-fb0f4ed1-f5cb-4335-9cf2-1386bbfc5a72 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:14.578903 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fb0f4ed1-f5cb-4335-9cf2-1386bbfc5a72 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:14.579545 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fb0f4ed1-f5cb-4335-9cf2-1386bbfc5a72 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:14.580473 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fb0f4ed1-f5cb-4335-9cf2-1386bbfc5a72 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:14.581348 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fb0f4ed1-f5cb-4335-9cf2-1386bbfc5a72 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:14.808243 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-fb0f4ed1-f5cb-4335-9cf2-1386bbfc5a72 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:14.818920 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-fb0f4ed1-f5cb-4335-9cf2-1386bbfc5a72 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1707 microversion: 2.1 time: 0.252945 Apr 15 19:57:14.819761 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 323/733] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:14 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1707 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:57:14.859940 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-1959440c-49ef-4eaa-a0bf-0e017014d26f tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:14.860623 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-1959440c-49ef-4eaa-a0bf-0e017014d26f tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:14.868579 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1959440c-49ef-4eaa-a0bf-0e017014d26f tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:14.869144 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1959440c-49ef-4eaa-a0bf-0e017014d26f tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:14.869991 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1959440c-49ef-4eaa-a0bf-0e017014d26f tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:14.870496 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1959440c-49ef-4eaa-a0bf-0e017014d26f tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:15.019454 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6d4a1682-1be2-456a-a251-a4e6d38da568 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:15.020138 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6d4a1682-1be2-456a-a251-a4e6d38da568 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:15.028056 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6d4a1682-1be2-456a-a251-a4e6d38da568 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:15.028601 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6d4a1682-1be2-456a-a251-a4e6d38da568 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:15.035433 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6d4a1682-1be2-456a-a251-a4e6d38da568 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:15.035946 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6d4a1682-1be2-456a-a251-a4e6d38da568 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:15.084721 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-1959440c-49ef-4eaa-a0bf-0e017014d26f tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:15.094080 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-1959440c-49ef-4eaa-a0bf-0e017014d26f tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1261 microversion: 2.1 time: 0.238696 Apr 15 19:57:15.095019 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 411/734] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:14 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1261 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:57:15.258332 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-6d4a1682-1be2-456a-a251-a4e6d38da568 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:15.269999 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-6d4a1682-1be2-456a-a251-a4e6d38da568 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:15.277731 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-6d4a1682-1be2-456a-a251-a4e6d38da568 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:15.279968 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6d4a1682-1be2-456a-a251-a4e6d38da568 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1810 microversion: 2.20 time: 0.265574 Apr 15 19:57:15.281229 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 324/735] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:57:15 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1810 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:57:15.837370 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f049ffe3-0408-4946-87e2-238d7bc546e4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:15.838132 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f049ffe3-0408-4946-87e2-238d7bc546e4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:15.847086 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f049ffe3-0408-4946-87e2-238d7bc546e4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:15.847621 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f049ffe3-0408-4946-87e2-238d7bc546e4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:15.848459 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f049ffe3-0408-4946-87e2-238d7bc546e4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:15.848958 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f049ffe3-0408-4946-87e2-238d7bc546e4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:16.112478 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-4172ee31-138a-4560-829e-8945c9af24fb tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:16.113157 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-4172ee31-138a-4560-829e-8945c9af24fb tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:16.120927 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4172ee31-138a-4560-829e-8945c9af24fb tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:16.121436 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4172ee31-138a-4560-829e-8945c9af24fb tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:16.122761 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4172ee31-138a-4560-829e-8945c9af24fb tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:16.123252 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4172ee31-138a-4560-829e-8945c9af24fb tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:16.151907 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f049ffe3-0408-4946-87e2-238d7bc546e4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:16.161940 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f049ffe3-0408-4946-87e2-238d7bc546e4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1711 microversion: 2.1 time: 0.328544 Apr 15 19:57:16.162552 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 412/736] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:15 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1711 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:57:16.300411 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b8e7aabc-af07-4a9a-9f42-e67dd9e28ef5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:16.301117 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b8e7aabc-af07-4a9a-9f42-e67dd9e28ef5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:16.309006 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b8e7aabc-af07-4a9a-9f42-e67dd9e28ef5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:16.310095 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b8e7aabc-af07-4a9a-9f42-e67dd9e28ef5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:16.311331 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b8e7aabc-af07-4a9a-9f42-e67dd9e28ef5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:16.311468 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b8e7aabc-af07-4a9a-9f42-e67dd9e28ef5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:16.502649 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-4172ee31-138a-4560-829e-8945c9af24fb tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:16.511989 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-4172ee31-138a-4560-829e-8945c9af24fb tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1444 microversion: 2.1 time: 0.403597 Apr 15 19:57:16.512620 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 325/737] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:16 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1444 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:57:16.530397 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9a64fc8e-d523-41ee-bd96-19eebf945bb9 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:16.531358 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9a64fc8e-d523-41ee-bd96-19eebf945bb9 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:16.545448 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9a64fc8e-d523-41ee-bd96-19eebf945bb9 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:16.545909 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9a64fc8e-d523-41ee-bd96-19eebf945bb9 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:16.546749 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9a64fc8e-d523-41ee-bd96-19eebf945bb9 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:16.547244 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9a64fc8e-d523-41ee-bd96-19eebf945bb9 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:16.615074 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b8e7aabc-af07-4a9a-9f42-e67dd9e28ef5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:16.627569 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b8e7aabc-af07-4a9a-9f42-e67dd9e28ef5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:16.629387 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b8e7aabc-af07-4a9a-9f42-e67dd9e28ef5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:16.630483 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b8e7aabc-af07-4a9a-9f42-e67dd9e28ef5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1810 microversion: 2.20 time: 0.334145 Apr 15 19:57:16.631101 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 413/738] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:57:16 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1810 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 19:57:16.793461 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9a64fc8e-d523-41ee-bd96-19eebf945bb9 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:16.803521 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9a64fc8e-d523-41ee-bd96-19eebf945bb9 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1444 microversion: 2.1 time: 0.277306 Apr 15 19:57:16.804313 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 326/739] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:16 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1444 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:57:17.650320 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-54a910db-ca6d-4526-9523-766e566cc222 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:17.651101 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-54a910db-ca6d-4526-9523-766e566cc222 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:17.659700 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-54a910db-ca6d-4526-9523-766e566cc222 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:17.660224 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-54a910db-ca6d-4526-9523-766e566cc222 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:17.661123 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-54a910db-ca6d-4526-9523-766e566cc222 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:17.661625 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-54a910db-ca6d-4526-9523-766e566cc222 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:17.886090 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-54a910db-ca6d-4526-9523-766e566cc222 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:17.897445 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-54a910db-ca6d-4526-9523-766e566cc222 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:17.899808 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-54a910db-ca6d-4526-9523-766e566cc222 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:17.901547 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-54a910db-ca6d-4526-9523-766e566cc222 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1810 microversion: 2.20 time: 0.255353 Apr 15 19:57:17.902513 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 414/740] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:57:17 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1810 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:57:18.923920 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-63358ef1-4833-410e-8430-77badbe1ca93 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:18.924581 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-63358ef1-4833-410e-8430-77badbe1ca93 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:18.934020 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-63358ef1-4833-410e-8430-77badbe1ca93 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:18.935137 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-63358ef1-4833-410e-8430-77badbe1ca93 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:18.936020 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-63358ef1-4833-410e-8430-77badbe1ca93 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:18.936508 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-63358ef1-4833-410e-8430-77badbe1ca93 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:19.181749 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-63358ef1-4833-410e-8430-77badbe1ca93 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:19.193017 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-63358ef1-4833-410e-8430-77badbe1ca93 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:19.194678 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-63358ef1-4833-410e-8430-77badbe1ca93 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:19.196187 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-63358ef1-4833-410e-8430-77badbe1ca93 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1810 microversion: 2.20 time: 0.278604 Apr 15 19:57:19.196516 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 327/741] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:57:18 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1810 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 19:57:20.217992 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-21bb3e72-0472-423a-9279-7cbc02770716 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:20.221135 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-21bb3e72-0472-423a-9279-7cbc02770716 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:20.229719 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-21bb3e72-0472-423a-9279-7cbc02770716 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:20.231456 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-21bb3e72-0472-423a-9279-7cbc02770716 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:20.234758 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-21bb3e72-0472-423a-9279-7cbc02770716 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:20.235392 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-21bb3e72-0472-423a-9279-7cbc02770716 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:20.314899 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-c59d2ac0-69d8-4a0e-a935-1b76058d0502 req-d49d4285-8c22-4f44-9f5a-150c37ba3122 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c241efcb-ba90-43dd-a6c3-393b77086172", "tag": "32a87087-67a6-454d-8830-c295f0d8e889"}]} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:57:20.316724 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:57:20.316724 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:57:20.326465 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-c59d2ac0-69d8-4a0e-a935-1b76058d0502 req-d49d4285-8c22-4f44-9f5a-150c37ba3122 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:20.326965 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-c59d2ac0-69d8-4a0e-a935-1b76058d0502 req-d49d4285-8c22-4f44-9f5a-150c37ba3122 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:20.350024 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-c59d2ac0-69d8-4a0e-a935-1b76058d0502 req-d49d4285-8c22-4f44-9f5a-150c37ba3122 service nova] Creating event network-changed:32a87087-67a6-454d-8830-c295f0d8e889 for instance c241efcb-ba90-43dd-a6c3-393b77086172 on hv-cinder-78638 Apr 15 19:57:20.355393 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-c59d2ac0-69d8-4a0e-a935-1b76058d0502 req-d49d4285-8c22-4f44-9f5a-150c37ba3122 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.240100 Apr 15 19:57:20.356465 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 415/742] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:57:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:57:20.362795 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-1ab80441-2ee9-4834-adf9-2152ed20cd61 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:20.364240 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-1ab80441-2ee9-4834-adf9-2152ed20cd61 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:20.372864 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1ab80441-2ee9-4834-adf9-2152ed20cd61 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:20.373490 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1ab80441-2ee9-4834-adf9-2152ed20cd61 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:20.374877 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1ab80441-2ee9-4834-adf9-2152ed20cd61 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:20.375405 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1ab80441-2ee9-4834-adf9-2152ed20cd61 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:20.564571 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-21bb3e72-0472-423a-9279-7cbc02770716 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:20.585538 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-21bb3e72-0472-423a-9279-7cbc02770716 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:20.588194 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-21bb3e72-0472-423a-9279-7cbc02770716 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:20.594358 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-21bb3e72-0472-423a-9279-7cbc02770716 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1810 microversion: 2.20 time: 0.382176 Apr 15 19:57:20.595248 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 328/743] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:57:20 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1810 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:57:20.656318 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-1ab80441-2ee9-4834-adf9-2152ed20cd61 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:20.667550 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-1ab80441-2ee9-4834-adf9-2152ed20cd61 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1594 microversion: 2.1 time: 0.309553 Apr 15 19:57:20.668559 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 416/744] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:20 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1594 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:57:21.388101 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-1caab9f7-0cb8-4ed7-89f2-f01bfe0eb790 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:21.388750 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-1caab9f7-0cb8-4ed7-89f2-f01bfe0eb790 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: a5f4046a-6bc2-4099-afa3-c1a2d16c38f0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:21.397694 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1caab9f7-0cb8-4ed7-89f2-f01bfe0eb790 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:21.398661 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1caab9f7-0cb8-4ed7-89f2-f01bfe0eb790 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:21.399531 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1caab9f7-0cb8-4ed7-89f2-f01bfe0eb790 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:21.400222 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1caab9f7-0cb8-4ed7-89f2-f01bfe0eb790 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:21.468597 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-1caab9f7-0cb8-4ed7-89f2-f01bfe0eb790 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: a5f4046a-6bc2-4099-afa3-c1a2d16c38f0] Going to try to terminate instance {{(pid=99512) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 15 19:57:21.590959 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-1caab9f7-0cb8-4ed7-89f2-f01bfe0eb790 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0" status: 204 len: 0 microversion: 2.1 time: 0.207222 Apr 15 19:57:21.592420 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 329/745] 10.222.0.58 () {58 vars in 1229 bytes} [Thu Apr 15 19:57:21 2021] DELETE /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 15 19:57:21.600788 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-44b6e1f1-3e9a-4635-8f63-6d5105fb07ef tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:21.601568 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-44b6e1f1-3e9a-4635-8f63-6d5105fb07ef tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: a5f4046a-6bc2-4099-afa3-c1a2d16c38f0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:21.610015 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-44b6e1f1-3e9a-4635-8f63-6d5105fb07ef tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:21.610827 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-44b6e1f1-3e9a-4635-8f63-6d5105fb07ef tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:21.611922 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-44b6e1f1-3e9a-4635-8f63-6d5105fb07ef tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:21.612629 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-44b6e1f1-3e9a-4635-8f63-6d5105fb07ef tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:21.616306 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-cb93588c-ae82-4170-97cd-03d3d37a1c8e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:21.617063 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-cb93588c-ae82-4170-97cd-03d3d37a1c8e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:21.626514 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cb93588c-ae82-4170-97cd-03d3d37a1c8e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:21.627302 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cb93588c-ae82-4170-97cd-03d3d37a1c8e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:21.628298 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cb93588c-ae82-4170-97cd-03d3d37a1c8e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:21.628928 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cb93588c-ae82-4170-97cd-03d3d37a1c8e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:21.954979 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-44b6e1f1-3e9a-4635-8f63-6d5105fb07ef tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb2653fe9004615a5ecf575c999c2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bc040eb9af4c96ac478d1091ca1b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:21.964516 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-44b6e1f1-3e9a-4635-8f63-6d5105fb07ef tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0" status: 200 len: 1514 microversion: 2.1 time: 0.367787 Apr 15 19:57:21.965724 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 417/746] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:21 2021] GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0 => generated 1514 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:57:21.968560 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-cb93588c-ae82-4170-97cd-03d3d37a1c8e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:21.978871 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-cb93588c-ae82-4170-97cd-03d3d37a1c8e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:21.980608 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-cb93588c-ae82-4170-97cd-03d3d37a1c8e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:21.981873 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-cb93588c-ae82-4170-97cd-03d3d37a1c8e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1810 microversion: 2.20 time: 0.370315 Apr 15 19:57:21.982638 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 330/747] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:57:21 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1810 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:57:22.983171 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b848be4f-09d3-4a14-aa77-a678fd468a06 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:22.983994 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b848be4f-09d3-4a14-aa77-a678fd468a06 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: a5f4046a-6bc2-4099-afa3-c1a2d16c38f0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:22.991882 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b848be4f-09d3-4a14-aa77-a678fd468a06 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:22.992478 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b848be4f-09d3-4a14-aa77-a678fd468a06 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:22.993310 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b848be4f-09d3-4a14-aa77-a678fd468a06 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:22.993796 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b848be4f-09d3-4a14-aa77-a678fd468a06 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:23.001737 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-3b1f41ca-9086-484a-b247-d3b53986d6ad tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:23.002410 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-3b1f41ca-9086-484a-b247-d3b53986d6ad tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:23.010491 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3b1f41ca-9086-484a-b247-d3b53986d6ad tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:23.011006 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3b1f41ca-9086-484a-b247-d3b53986d6ad tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:23.011899 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3b1f41ca-9086-484a-b247-d3b53986d6ad tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:23.012441 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3b1f41ca-9086-484a-b247-d3b53986d6ad tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:23.310522 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b848be4f-09d3-4a14-aa77-a678fd468a06 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb2653fe9004615a5ecf575c999c2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bc040eb9af4c96ac478d1091ca1b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:23.324741 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b848be4f-09d3-4a14-aa77-a678fd468a06 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0" status: 200 len: 1514 microversion: 2.1 time: 0.345440 Apr 15 19:57:23.326405 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 418/748] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:22 2021] GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0 => generated 1514 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:57:23.334325 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3b1f41ca-9086-484a-b247-d3b53986d6ad tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:23.345626 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3b1f41ca-9086-484a-b247-d3b53986d6ad tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:23.347325 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3b1f41ca-9086-484a-b247-d3b53986d6ad tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:23.348795 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-3b1f41ca-9086-484a-b247-d3b53986d6ad tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1810 microversion: 2.20 time: 0.351758 Apr 15 19:57:23.349631 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 331/749] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:57:22 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1810 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 19:57:24.342942 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-980bca33-2f7e-4f50-b886-75152486af9e tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:24.343738 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-980bca33-2f7e-4f50-b886-75152486af9e tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: a5f4046a-6bc2-4099-afa3-c1a2d16c38f0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:24.361277 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-980bca33-2f7e-4f50-b886-75152486af9e tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:24.368591 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-96f04125-0669-48b4-a62a-b8aa163cedde tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:24.369493 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-96f04125-0669-48b4-a62a-b8aa163cedde tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:24.375143 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-980bca33-2f7e-4f50-b886-75152486af9e tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:24.376562 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-980bca33-2f7e-4f50-b886-75152486af9e tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:24.378229 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-980bca33-2f7e-4f50-b886-75152486af9e tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:24.389457 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-96f04125-0669-48b4-a62a-b8aa163cedde tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:24.389973 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-96f04125-0669-48b4-a62a-b8aa163cedde tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:24.391010 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-96f04125-0669-48b4-a62a-b8aa163cedde tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:24.391593 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-96f04125-0669-48b4-a62a-b8aa163cedde tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:24.929993 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-96f04125-0669-48b4-a62a-b8aa163cedde tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:24.960345 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-96f04125-0669-48b4-a62a-b8aa163cedde tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:24.960501 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-980bca33-2f7e-4f50-b886-75152486af9e tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb2653fe9004615a5ecf575c999c2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bc040eb9af4c96ac478d1091ca1b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:24.965793 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-96f04125-0669-48b4-a62a-b8aa163cedde tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:24.967862 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-96f04125-0669-48b4-a62a-b8aa163cedde tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1810 microversion: 2.20 time: 0.603122 Apr 15 19:57:24.968667 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 332/750] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:57:24 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1810 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:57:24.980757 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-4d4f4b1b-4716-4363-90f5-db0a47b076d2 req-4da28ee7-4c97-46fd-b601-c1c2ec8ac13d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1ea7a7c-3e3e-47c5-8955-a3b27a52d453", "tag": "619a8492-f932-4048-8258-fe9757a50525"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:57:24.982388 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-980bca33-2f7e-4f50-b886-75152486af9e tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0" status: 200 len: 1514 microversion: 2.1 time: 0.643725 Apr 15 19:57:24.983048 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 419/751] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:24 2021] GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0 => generated 1514 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:57:24.987305 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:57:24.987305 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:57:25.004939 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-4d4f4b1b-4716-4363-90f5-db0a47b076d2 req-4da28ee7-4c97-46fd-b601-c1c2ec8ac13d service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:25.005445 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-4d4f4b1b-4716-4363-90f5-db0a47b076d2 req-4da28ee7-4c97-46fd-b601-c1c2ec8ac13d service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:25.027785 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-4d4f4b1b-4716-4363-90f5-db0a47b076d2 req-4da28ee7-4c97-46fd-b601-c1c2ec8ac13d service nova] Creating event network-changed:619a8492-f932-4048-8258-fe9757a50525 for instance b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 on hv-cinder-78638 Apr 15 19:57:25.034022 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-4d4f4b1b-4716-4363-90f5-db0a47b076d2 req-4da28ee7-4c97-46fd-b601-c1c2ec8ac13d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063630 Apr 15 19:57:25.034446 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 333/752] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:57:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:57:25.988391 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-179ef4e9-8c81-48ba-a747-32d65449da93 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:25.989204 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-179ef4e9-8c81-48ba-a747-32d65449da93 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:26.003732 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-179ef4e9-8c81-48ba-a747-32d65449da93 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:26.003986 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-0cc0f52d-3480-470b-8ff0-b1aa224f4475 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:26.005113 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-0cc0f52d-3480-470b-8ff0-b1aa224f4475 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: a5f4046a-6bc2-4099-afa3-c1a2d16c38f0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:26.009289 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-179ef4e9-8c81-48ba-a747-32d65449da93 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:26.010446 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-179ef4e9-8c81-48ba-a747-32d65449da93 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:26.011044 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-179ef4e9-8c81-48ba-a747-32d65449da93 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:26.025992 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0cc0f52d-3480-470b-8ff0-b1aa224f4475 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:26.026778 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0cc0f52d-3480-470b-8ff0-b1aa224f4475 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:26.028124 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0cc0f52d-3480-470b-8ff0-b1aa224f4475 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:26.029105 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0cc0f52d-3480-470b-8ff0-b1aa224f4475 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:26.127912 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0cc0f52d-3480-470b-8ff0-b1aa224f4475 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:26.128791 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0cc0f52d-3480-470b-8ff0-b1aa224f4475 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:26.129504 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.objects.instance [None req-0cc0f52d-3480-470b-8ff0-b1aa224f4475 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lazy-loading 'fault' on Instance uuid a5f4046a-6bc2-4099-afa3-c1a2d16c38f0 {{(pid=99512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 15 19:57:26.272335 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-0cc0f52d-3480-470b-8ff0-b1aa224f4475 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb2653fe9004615a5ecf575c999c2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bc040eb9af4c96ac478d1091ca1b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:26.287964 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-0cc0f52d-3480-470b-8ff0-b1aa224f4475 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0" status: 200 len: 1309 microversion: 2.1 time: 0.290579 Apr 15 19:57:26.289358 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 334/753] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:25 2021] GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0 => generated 1309 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:57:26.295727 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-6da1de09-8371-4031-999f-5fcd2397c709 req-765327e4-9566-4122-baec-768554a6e435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0ac4cf-7982-406b-a2f0-115ca5721a10", "name": "network-vif-plugged", "status": "completed", "tag": "431c18ae-c617-4e1e-bca6-7134661c98e1"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:57:26.298140 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:57:26.298140 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:57:26.307253 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-6da1de09-8371-4031-999f-5fcd2397c709 req-765327e4-9566-4122-baec-768554a6e435 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:26.307777 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-6da1de09-8371-4031-999f-5fcd2397c709 req-765327e4-9566-4122-baec-768554a6e435 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:26.331966 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-6da1de09-8371-4031-999f-5fcd2397c709 req-765327e4-9566-4122-baec-768554a6e435 service nova] Creating event network-vif-plugged:431c18ae-c617-4e1e-bca6-7134661c98e1 for instance 6c0ac4cf-7982-406b-a2f0-115ca5721a10 on hv-cinder-78638 Apr 15 19:57:26.337544 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-6da1de09-8371-4031-999f-5fcd2397c709 req-765327e4-9566-4122-baec-768554a6e435 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046243 Apr 15 19:57:26.338462 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 335/754] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:57:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:57:26.421957 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-179ef4e9-8c81-48ba-a747-32d65449da93 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:26.434480 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-179ef4e9-8c81-48ba-a747-32d65449da93 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:26.438275 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-179ef4e9-8c81-48ba-a747-32d65449da93 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:26.439733 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-179ef4e9-8c81-48ba-a747-32d65449da93 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1810 microversion: 2.20 time: 0.456474 Apr 15 19:57:26.440145 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 420/755] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:57:25 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1810 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:57:27.063432 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-46453888-3db4-436e-856d-3a8341127fcf tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1882817170"}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:57:27.064111 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-46453888-3db4-436e-856d-3a8341127fcf tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:27.072829 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-46453888-3db4-436e-856d-3a8341127fcf tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:27.073344 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-46453888-3db4-436e-856d-3a8341127fcf tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:27.074203 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-46453888-3db4-436e-856d-3a8341127fcf tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:27.074843 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-46453888-3db4-436e-856d-3a8341127fcf tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:27.132527 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-982e6da6-65a5-44bb-8ff7-10b5a5dded72 req-d2983888-0efa-49b8-9e01-808be57d7983 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5f4046a-6bc2-4099-afa3-c1a2d16c38f0", "name": "network-vif-deleted", "tag": "b4edfcb4-a2bd-4e43-83b4-3f5d12f99260"}]} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:57:27.134301 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:57:27.134301 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:57:27.144048 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-982e6da6-65a5-44bb-8ff7-10b5a5dded72 req-d2983888-0efa-49b8-9e01-808be57d7983 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:27.144751 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-982e6da6-65a5-44bb-8ff7-10b5a5dded72 req-d2983888-0efa-49b8-9e01-808be57d7983 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:27.165189 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-982e6da6-65a5-44bb-8ff7-10b5a5dded72 req-d2983888-0efa-49b8-9e01-808be57d7983 service nova] Creating event network-vif-deleted:b4edfcb4-a2bd-4e43-83b4-3f5d12f99260 for instance a5f4046a-6bc2-4099-afa3-c1a2d16c38f0 on hv-cinder-78638 Apr 15 19:57:27.171150 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-982e6da6-65a5-44bb-8ff7-10b5a5dded72 req-d2983888-0efa-49b8-9e01-808be57d7983 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042114 Apr 15 19:57:27.171823 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 421/756] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:57:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 15 19:57:27.311183 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e6a93f21-b566-4a61-9e20-34f1ef3a4fbb tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:27.312000 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e6a93f21-b566-4a61-9e20-34f1ef3a4fbb tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: a5f4046a-6bc2-4099-afa3-c1a2d16c38f0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:27.320726 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e6a93f21-b566-4a61-9e20-34f1ef3a4fbb tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:27.321230 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e6a93f21-b566-4a61-9e20-34f1ef3a4fbb tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:27.322093 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e6a93f21-b566-4a61-9e20-34f1ef3a4fbb tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:27.322587 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e6a93f21-b566-4a61-9e20-34f1ef3a4fbb tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:27.386347 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-e6a93f21-b566-4a61-9e20-34f1ef3a4fbb tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] HTTP exception thrown: Instance a5f4046a-6bc2-4099-afa3-c1a2d16c38f0 could not be found. Apr 15 19:57:27.387029 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e6a93f21-b566-4a61-9e20-34f1ef3a4fbb tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Returning 404 to user: Instance a5f4046a-6bc2-4099-afa3-c1a2d16c38f0 could not be found. {{(pid=99511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 19:57:27.388618 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e6a93f21-b566-4a61-9e20-34f1ef3a4fbb tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0" status: 404 len: 111 microversion: 2.1 time: 0.082210 Apr 15 19:57:27.389220 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 422/757] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:27 2021] GET /compute/v2.1/servers/a5f4046a-6bc2-4099-afa3-c1a2d16c38f0 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 15 19:57:27.462889 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a940c1bd-1796-4752-bb43-42862ca0e0b3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:27.463868 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a940c1bd-1796-4752-bb43-42862ca0e0b3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:27.473500 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a940c1bd-1796-4752-bb43-42862ca0e0b3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:27.474171 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a940c1bd-1796-4752-bb43-42862ca0e0b3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:27.475516 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a940c1bd-1796-4752-bb43-42862ca0e0b3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:27.476475 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a940c1bd-1796-4752-bb43-42862ca0e0b3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:27.517853 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.network.security_group_api [None req-46453888-3db4-436e-856d-3a8341127fcf tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Adding security group bc6b6b69-666b-4890-857e-c2b16a23866b to port 619a8492-f932-4048-8258-fe9757a50525 Apr 15 19:57:27.855319 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a940c1bd-1796-4752-bb43-42862ca0e0b3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:27.866217 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a940c1bd-1796-4752-bb43-42862ca0e0b3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:27.868577 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a940c1bd-1796-4752-bb43-42862ca0e0b3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:27.869863 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a940c1bd-1796-4752-bb43-42862ca0e0b3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1810 microversion: 2.20 time: 0.411138 Apr 15 19:57:27.870764 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 423/758] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:57:27 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1810 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 19:57:28.338607 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-46453888-3db4-436e-856d-3a8341127fcf tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "POST /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453/action" status: 202 len: 0 microversion: 2.1 time: 1.281118 Apr 15 19:57:28.344099 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 336/759] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:57:27 2021] POST /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453/action => generated 0 bytes in 1287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:57:28.357424 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7bd3c6c5-82e1-4422-a1ab-49c79840cd67 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:28.358696 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7bd3c6c5-82e1-4422-a1ab-49c79840cd67 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:28.368240 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7bd3c6c5-82e1-4422-a1ab-49c79840cd67 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:28.369442 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7bd3c6c5-82e1-4422-a1ab-49c79840cd67 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:28.370579 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7bd3c6c5-82e1-4422-a1ab-49c79840cd67 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:28.371079 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7bd3c6c5-82e1-4422-a1ab-49c79840cd67 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:28.572262 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-362c59dc-b551-4d69-9469-46ba9076a5aa req-10319fc7-a5fe-40d1-af9b-fe5745893f4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1ea7a7c-3e3e-47c5-8955-a3b27a52d453", "tag": "619a8492-f932-4048-8258-fe9757a50525"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:57:28.574014 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:57:28.574014 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:57:28.583867 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-362c59dc-b551-4d69-9469-46ba9076a5aa req-10319fc7-a5fe-40d1-af9b-fe5745893f4d service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:28.584822 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-362c59dc-b551-4d69-9469-46ba9076a5aa req-10319fc7-a5fe-40d1-af9b-fe5745893f4d service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:28.603335 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-362c59dc-b551-4d69-9469-46ba9076a5aa req-10319fc7-a5fe-40d1-af9b-fe5745893f4d service nova] Creating event network-changed:619a8492-f932-4048-8258-fe9757a50525 for instance b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 on hv-cinder-78638 Apr 15 19:57:28.609379 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-362c59dc-b551-4d69-9469-46ba9076a5aa req-10319fc7-a5fe-40d1-af9b-fe5745893f4d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.258127 Apr 15 19:57:28.610257 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 337/760] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:57:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:57:28.677022 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-7bd3c6c5-82e1-4422-a1ab-49c79840cd67 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:28.696315 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7bd3c6c5-82e1-4422-a1ab-49c79840cd67 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1760 microversion: 2.1 time: 0.350796 Apr 15 19:57:28.696928 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 424/761] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:28 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1760 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:57:28.890809 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-dd303ca0-30e3-4f47-9013-c5361c9c0d4c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:28.891602 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-dd303ca0-30e3-4f47-9013-c5361c9c0d4c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:28.899604 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dd303ca0-30e3-4f47-9013-c5361c9c0d4c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:28.900111 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dd303ca0-30e3-4f47-9013-c5361c9c0d4c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:28.900937 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dd303ca0-30e3-4f47-9013-c5361c9c0d4c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:28.901475 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dd303ca0-30e3-4f47-9013-c5361c9c0d4c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:29.230740 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-dd303ca0-30e3-4f47-9013-c5361c9c0d4c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:29.240919 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-dd303ca0-30e3-4f47-9013-c5361c9c0d4c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:29.242598 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-dd303ca0-30e3-4f47-9013-c5361c9c0d4c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:29.243895 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-dd303ca0-30e3-4f47-9013-c5361c9c0d4c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1810 microversion: 2.20 time: 0.357821 Apr 15 19:57:29.244510 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 338/762] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:57:28 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1810 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:57:30.262145 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-4a1bd528-7b0f-4be2-9357-37919fb42c45 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:30.263183 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-4a1bd528-7b0f-4be2-9357-37919fb42c45 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:30.271052 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4a1bd528-7b0f-4be2-9357-37919fb42c45 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:30.271588 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4a1bd528-7b0f-4be2-9357-37919fb42c45 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:30.272466 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4a1bd528-7b0f-4be2-9357-37919fb42c45 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:30.272956 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4a1bd528-7b0f-4be2-9357-37919fb42c45 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:30.497272 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-4a1bd528-7b0f-4be2-9357-37919fb42c45 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:30.507738 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-4a1bd528-7b0f-4be2-9357-37919fb42c45 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:30.509575 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-4a1bd528-7b0f-4be2-9357-37919fb42c45 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:30.510887 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-4a1bd528-7b0f-4be2-9357-37919fb42c45 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1810 microversion: 2.20 time: 0.252856 Apr 15 19:57:30.511639 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 425/763] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:57:30 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1810 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:57:31.529738 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c046d547-168c-48ad-a526-ba4abdab6017 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:31.530552 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c046d547-168c-48ad-a526-ba4abdab6017 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:31.538393 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c046d547-168c-48ad-a526-ba4abdab6017 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:31.538913 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c046d547-168c-48ad-a526-ba4abdab6017 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:31.539782 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c046d547-168c-48ad-a526-ba4abdab6017 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:31.540536 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c046d547-168c-48ad-a526-ba4abdab6017 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:31.759029 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c046d547-168c-48ad-a526-ba4abdab6017 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:31.769227 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c046d547-168c-48ad-a526-ba4abdab6017 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:31.770902 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c046d547-168c-48ad-a526-ba4abdab6017 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:31.772151 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c046d547-168c-48ad-a526-ba4abdab6017 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1810 microversion: 2.20 time: 0.246642 Apr 15 19:57:31.772776 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 339/764] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:57:31 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1810 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:57:32.792760 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ecd4575e-0896-44c3-8efc-d89dcb8be6d3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:32.794948 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ecd4575e-0896-44c3-8efc-d89dcb8be6d3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:32.812209 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ecd4575e-0896-44c3-8efc-d89dcb8be6d3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:32.813134 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ecd4575e-0896-44c3-8efc-d89dcb8be6d3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:32.814840 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ecd4575e-0896-44c3-8efc-d89dcb8be6d3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:32.815360 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ecd4575e-0896-44c3-8efc-d89dcb8be6d3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:33.416116 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ecd4575e-0896-44c3-8efc-d89dcb8be6d3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:33.427880 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ecd4575e-0896-44c3-8efc-d89dcb8be6d3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:33.429586 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ecd4575e-0896-44c3-8efc-d89dcb8be6d3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:33.430808 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ecd4575e-0896-44c3-8efc-d89dcb8be6d3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1810 microversion: 2.20 time: 0.642777 Apr 15 19:57:33.431449 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 426/765] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:57:32 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1810 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:57:34.449791 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e8aea9a1-f63c-4e66-8b3e-9d536a34e89c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:34.451059 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e8aea9a1-f63c-4e66-8b3e-9d536a34e89c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:34.459855 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e8aea9a1-f63c-4e66-8b3e-9d536a34e89c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:34.460610 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e8aea9a1-f63c-4e66-8b3e-9d536a34e89c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:34.461596 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e8aea9a1-f63c-4e66-8b3e-9d536a34e89c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:34.462103 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e8aea9a1-f63c-4e66-8b3e-9d536a34e89c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:34.698608 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-e8aea9a1-f63c-4e66-8b3e-9d536a34e89c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:34.709263 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-e8aea9a1-f63c-4e66-8b3e-9d536a34e89c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:34.710941 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-e8aea9a1-f63c-4e66-8b3e-9d536a34e89c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:34.712192 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e8aea9a1-f63c-4e66-8b3e-9d536a34e89c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1797 microversion: 2.20 time: 0.266571 Apr 15 19:57:34.712803 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 340/766] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:57:34 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1797 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:57:45.203221 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-3ffdc283-3aa1-4b1f-b165-b547c110c4d2 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-213334115", "imageRef": "10d66d6e-f687-4228-93d1-67502c9b42e2", "flavorRef": "452", "networks": [{"uuid": "04ccfe32-3031-4e0e-8687-0a32f699824a"}]}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:57:45.274771 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.network.neutron [None req-3ffdc283-3aa1-4b1f-b165-b547c110c4d2 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] validate_networks() for [('04ccfe32-3031-4e0e-8687-0a32f699824a', None, None, None)] {{(pid=99511) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 15 19:57:45.900132 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-3ffdc283-3aa1-4b1f-b165-b547c110c4d2 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Flavor limits 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 15 19:57:45.900608 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-3ffdc283-3aa1-4b1f-b165-b547c110c4d2 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Image limits 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 15 19:57:45.901152 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-3ffdc283-3aa1-4b1f-b165-b547c110c4d2 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Flavor pref 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 15 19:57:45.901613 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-3ffdc283-3aa1-4b1f-b165-b547c110c4d2 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Image pref 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 15 19:57:45.902081 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-3ffdc283-3aa1-4b1f-b165-b547c110c4d2 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 15 19:57:45.911698 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3ffdc283-3aa1-4b1f-b165-b547c110c4d2 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:45.912213 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3ffdc283-3aa1-4b1f-b165-b547c110c4d2 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:45.913114 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3ffdc283-3aa1-4b1f-b165-b547c110c4d2 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:45.913629 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3ffdc283-3aa1-4b1f-b165-b547c110c4d2 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:45.932975 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-3ffdc283-3aa1-4b1f-b165-b547c110c4d2 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Getting quotas for project 53bc040eb9af4c96ac478d1091ca1b60. Resources: {'cores', 'instances', 'ram'} {{(pid=99511) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 15 19:57:45.937294 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-3ffdc283-3aa1-4b1f-b165-b547c110c4d2 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Getting quotas for user 1cb2653fe9004615a5ecf575c999c2de and project 53bc040eb9af4c96ac478d1091ca1b60. Resources: {'cores', 'instances', 'ram'} {{(pid=99511) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 15 19:57:45.948561 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-3ffdc283-3aa1-4b1f-b165-b547c110c4d2 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Going to run 1 instances... {{(pid=99511) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 15 19:57:45.951121 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-3ffdc283-3aa1-4b1f-b165-b547c110c4d2 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: 848e70ee-4f74-46f4-bec6-84f3ec5a6309] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='10d66d6e-f687-4228-93d1-67502c9b42e2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 15 19:57:46.003256 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-3ffdc283-3aa1-4b1f-b165-b547c110c4d2 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.803911 Apr 15 19:57:46.003928 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 427/767] 10.222.0.58 () {60 vars in 1137 bytes} [Thu Apr 15 19:57:45 2021] POST /compute/v2.1/servers => generated 380 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 15 19:57:46.014886 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-23265395-8970-48b1-a315-8a0732025933 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:46.015594 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-23265395-8970-48b1-a315-8a0732025933 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: 848e70ee-4f74-46f4-bec6-84f3ec5a6309] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:46.097236 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-23265395-8970-48b1-a315-8a0732025933 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb2653fe9004615a5ecf575c999c2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bc040eb9af4c96ac478d1091ca1b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:46.105307 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-23265395-8970-48b1-a315-8a0732025933 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "GET /compute/v2.1/servers/848e70ee-4f74-46f4-bec6-84f3ec5a6309" status: 200 len: 1218 microversion: 2.1 time: 0.094686 Apr 15 19:57:46.105923 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 341/768] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:46 2021] GET /compute/v2.1/servers/848e70ee-4f74-46f4-bec6-84f3ec5a6309 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:57:47.123476 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9d15d016-838b-4f2d-bb33-7f374668335c tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:47.124164 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9d15d016-838b-4f2d-bb33-7f374668335c tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: 848e70ee-4f74-46f4-bec6-84f3ec5a6309] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:47.132150 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9d15d016-838b-4f2d-bb33-7f374668335c tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:47.132663 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9d15d016-838b-4f2d-bb33-7f374668335c tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:47.133511 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9d15d016-838b-4f2d-bb33-7f374668335c tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:47.134020 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9d15d016-838b-4f2d-bb33-7f374668335c tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:47.262980 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9d15d016-838b-4f2d-bb33-7f374668335c tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb2653fe9004615a5ecf575c999c2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bc040eb9af4c96ac478d1091ca1b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:47.274246 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9d15d016-838b-4f2d-bb33-7f374668335c tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "GET /compute/v2.1/servers/848e70ee-4f74-46f4-bec6-84f3ec5a6309" status: 200 len: 1270 microversion: 2.1 time: 0.154646 Apr 15 19:57:47.274874 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 428/769] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:47 2021] GET /compute/v2.1/servers/848e70ee-4f74-46f4-bec6-84f3ec5a6309 => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:57:48.294882 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7a3882f8-a386-42ff-88a4-1d33f55a111d tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:48.295839 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7a3882f8-a386-42ff-88a4-1d33f55a111d tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: 848e70ee-4f74-46f4-bec6-84f3ec5a6309] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:48.305821 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7a3882f8-a386-42ff-88a4-1d33f55a111d tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:48.306192 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7a3882f8-a386-42ff-88a4-1d33f55a111d tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:48.307150 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7a3882f8-a386-42ff-88a4-1d33f55a111d tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:48.307978 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7a3882f8-a386-42ff-88a4-1d33f55a111d tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:48.698915 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-7a3882f8-a386-42ff-88a4-1d33f55a111d tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb2653fe9004615a5ecf575c999c2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bc040eb9af4c96ac478d1091ca1b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:48.710991 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7a3882f8-a386-42ff-88a4-1d33f55a111d tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "GET /compute/v2.1/servers/848e70ee-4f74-46f4-bec6-84f3ec5a6309" status: 200 len: 1318 microversion: 2.1 time: 0.421866 Apr 15 19:57:48.711663 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 342/770] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:48 2021] GET /compute/v2.1/servers/848e70ee-4f74-46f4-bec6-84f3ec5a6309 => generated 1318 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:57:49.729630 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-da65525f-2073-425b-89d6-291279f03d45 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:49.730293 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-da65525f-2073-425b-89d6-291279f03d45 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: 848e70ee-4f74-46f4-bec6-84f3ec5a6309] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:49.738322 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-da65525f-2073-425b-89d6-291279f03d45 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:49.739061 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-da65525f-2073-425b-89d6-291279f03d45 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:49.739943 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-da65525f-2073-425b-89d6-291279f03d45 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:49.740450 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-da65525f-2073-425b-89d6-291279f03d45 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:50.038219 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-227a92fd-a816-4b3f-a14b-e7035c4a9193 req-856531a5-4330-4e8a-9c81-f37bad08295f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "848e70ee-4f74-46f4-bec6-84f3ec5a6309", "tag": "da2760ef-fd8b-466c-b2d5-110ab388fe82"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:57:50.040848 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:57:50.040848 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:57:50.057105 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-227a92fd-a816-4b3f-a14b-e7035c4a9193 req-856531a5-4330-4e8a-9c81-f37bad08295f service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:50.057914 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-227a92fd-a816-4b3f-a14b-e7035c4a9193 req-856531a5-4330-4e8a-9c81-f37bad08295f service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:50.076694 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-227a92fd-a816-4b3f-a14b-e7035c4a9193 req-856531a5-4330-4e8a-9c81-f37bad08295f service nova] Creating event network-changed:da2760ef-fd8b-466c-b2d5-110ab388fe82 for instance 848e70ee-4f74-46f4-bec6-84f3ec5a6309 on hv-cinder-78638 Apr 15 19:57:50.082851 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-227a92fd-a816-4b3f-a14b-e7035c4a9193 req-856531a5-4330-4e8a-9c81-f37bad08295f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048636 Apr 15 19:57:50.083626 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 343/771] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:57:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:57:50.156116 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-da65525f-2073-425b-89d6-291279f03d45 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb2653fe9004615a5ecf575c999c2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bc040eb9af4c96ac478d1091ca1b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:50.167869 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-da65525f-2073-425b-89d6-291279f03d45 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "GET /compute/v2.1/servers/848e70ee-4f74-46f4-bec6-84f3ec5a6309" status: 200 len: 1318 microversion: 2.1 time: 0.442462 Apr 15 19:57:50.168500 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 429/772] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:49 2021] GET /compute/v2.1/servers/848e70ee-4f74-46f4-bec6-84f3ec5a6309 => generated 1318 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:57:51.187042 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a0ae96d6-382c-4ea0-91a3-a3c8db1f9574 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:51.187937 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a0ae96d6-382c-4ea0-91a3-a3c8db1f9574 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: 848e70ee-4f74-46f4-bec6-84f3ec5a6309] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:51.197356 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a0ae96d6-382c-4ea0-91a3-a3c8db1f9574 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:51.197936 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a0ae96d6-382c-4ea0-91a3-a3c8db1f9574 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:51.198844 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a0ae96d6-382c-4ea0-91a3-a3c8db1f9574 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:51.199441 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a0ae96d6-382c-4ea0-91a3-a3c8db1f9574 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:51.802084 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a0ae96d6-382c-4ea0-91a3-a3c8db1f9574 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb2653fe9004615a5ecf575c999c2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bc040eb9af4c96ac478d1091ca1b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:51.812828 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a0ae96d6-382c-4ea0-91a3-a3c8db1f9574 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "GET /compute/v2.1/servers/848e70ee-4f74-46f4-bec6-84f3ec5a6309" status: 200 len: 1318 microversion: 2.1 time: 0.630308 Apr 15 19:57:51.814251 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 344/773] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:51 2021] GET /compute/v2.1/servers/848e70ee-4f74-46f4-bec6-84f3ec5a6309 => generated 1318 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:57:52.830612 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-5317f837-6b65-4076-b61a-06993ff64270 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:52.831875 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-5317f837-6b65-4076-b61a-06993ff64270 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: 848e70ee-4f74-46f4-bec6-84f3ec5a6309] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:52.840101 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5317f837-6b65-4076-b61a-06993ff64270 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:52.840652 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5317f837-6b65-4076-b61a-06993ff64270 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:52.841529 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5317f837-6b65-4076-b61a-06993ff64270 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:52.842064 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5317f837-6b65-4076-b61a-06993ff64270 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:53.062039 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-5317f837-6b65-4076-b61a-06993ff64270 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb2653fe9004615a5ecf575c999c2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bc040eb9af4c96ac478d1091ca1b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:53.071438 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-5317f837-6b65-4076-b61a-06993ff64270 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "GET /compute/v2.1/servers/848e70ee-4f74-46f4-bec6-84f3ec5a6309" status: 200 len: 1318 microversion: 2.1 time: 0.245051 Apr 15 19:57:53.072047 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 430/774] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:52 2021] GET /compute/v2.1/servers/848e70ee-4f74-46f4-bec6-84f3ec5a6309 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:57:54.089222 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7f249161-92a1-48ac-bcfc-e29a9fd8a39e tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:54.089930 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7f249161-92a1-48ac-bcfc-e29a9fd8a39e tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: 848e70ee-4f74-46f4-bec6-84f3ec5a6309] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:54.097759 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7f249161-92a1-48ac-bcfc-e29a9fd8a39e tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:54.098267 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7f249161-92a1-48ac-bcfc-e29a9fd8a39e tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:54.099088 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7f249161-92a1-48ac-bcfc-e29a9fd8a39e tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:54.099603 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7f249161-92a1-48ac-bcfc-e29a9fd8a39e tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:54.312853 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-7f249161-92a1-48ac-bcfc-e29a9fd8a39e tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb2653fe9004615a5ecf575c999c2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bc040eb9af4c96ac478d1091ca1b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:54.322152 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7f249161-92a1-48ac-bcfc-e29a9fd8a39e tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "GET /compute/v2.1/servers/848e70ee-4f74-46f4-bec6-84f3ec5a6309" status: 200 len: 1318 microversion: 2.1 time: 0.237035 Apr 15 19:57:54.322774 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 345/775] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:54 2021] GET /compute/v2.1/servers/848e70ee-4f74-46f4-bec6-84f3ec5a6309 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:57:55.340565 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-2eab7f2a-eec1-40ea-af97-b765f12518a5 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:55.341239 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-2eab7f2a-eec1-40ea-af97-b765f12518a5 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: 848e70ee-4f74-46f4-bec6-84f3ec5a6309] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:55.349786 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2eab7f2a-eec1-40ea-af97-b765f12518a5 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:55.350298 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2eab7f2a-eec1-40ea-af97-b765f12518a5 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:55.351132 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2eab7f2a-eec1-40ea-af97-b765f12518a5 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:55.351652 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2eab7f2a-eec1-40ea-af97-b765f12518a5 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:55.559816 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-2eab7f2a-eec1-40ea-af97-b765f12518a5 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb2653fe9004615a5ecf575c999c2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bc040eb9af4c96ac478d1091ca1b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:55.569032 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-2eab7f2a-eec1-40ea-af97-b765f12518a5 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "GET /compute/v2.1/servers/848e70ee-4f74-46f4-bec6-84f3ec5a6309" status: 200 len: 1318 microversion: 2.1 time: 0.232529 Apr 15 19:57:55.569642 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 431/776] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:55 2021] GET /compute/v2.1/servers/848e70ee-4f74-46f4-bec6-84f3ec5a6309 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:57:56.588487 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e2eb8a5e-8ce5-4030-b1c4-d3127898ebec tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:56.589162 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e2eb8a5e-8ce5-4030-b1c4-d3127898ebec tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: 848e70ee-4f74-46f4-bec6-84f3ec5a6309] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:56.597459 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e2eb8a5e-8ce5-4030-b1c4-d3127898ebec tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:56.597965 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e2eb8a5e-8ce5-4030-b1c4-d3127898ebec tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:56.598803 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e2eb8a5e-8ce5-4030-b1c4-d3127898ebec tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:56.599308 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e2eb8a5e-8ce5-4030-b1c4-d3127898ebec tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:56.872938 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-e2eb8a5e-8ce5-4030-b1c4-d3127898ebec tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb2653fe9004615a5ecf575c999c2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bc040eb9af4c96ac478d1091ca1b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:56.881872 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e2eb8a5e-8ce5-4030-b1c4-d3127898ebec tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "GET /compute/v2.1/servers/848e70ee-4f74-46f4-bec6-84f3ec5a6309" status: 200 len: 1318 microversion: 2.1 time: 0.297493 Apr 15 19:57:56.882493 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 346/777] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:56 2021] GET /compute/v2.1/servers/848e70ee-4f74-46f4-bec6-84f3ec5a6309 => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:57:57.900548 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ace4b74d-2606-4864-9302-764c7929737b tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:57.901228 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ace4b74d-2606-4864-9302-764c7929737b tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: 848e70ee-4f74-46f4-bec6-84f3ec5a6309] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:57.909627 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ace4b74d-2606-4864-9302-764c7929737b tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:57.910134 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ace4b74d-2606-4864-9302-764c7929737b tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:57.910968 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ace4b74d-2606-4864-9302-764c7929737b tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:57.911496 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ace4b74d-2606-4864-9302-764c7929737b tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:58.127128 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ace4b74d-2606-4864-9302-764c7929737b tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb2653fe9004615a5ecf575c999c2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bc040eb9af4c96ac478d1091ca1b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:58.135875 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ace4b74d-2606-4864-9302-764c7929737b tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "GET /compute/v2.1/servers/848e70ee-4f74-46f4-bec6-84f3ec5a6309" status: 200 len: 1318 microversion: 2.1 time: 0.239573 Apr 15 19:57:58.136478 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 432/778] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:57 2021] GET /compute/v2.1/servers/848e70ee-4f74-46f4-bec6-84f3ec5a6309 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:57:58.922273 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-cca8af59-54ba-4eab-b5c5-0f1a7926732c req-77a9323b-b53e-48e0-96ee-4c80db1a1c0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "848e70ee-4f74-46f4-bec6-84f3ec5a6309", "name": "network-vif-plugged", "status": "completed", "tag": "da2760ef-fd8b-466c-b2d5-110ab388fe82"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:57:58.924547 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:57:58.924547 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:57:58.933254 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-cca8af59-54ba-4eab-b5c5-0f1a7926732c req-77a9323b-b53e-48e0-96ee-4c80db1a1c0c service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:58.933760 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-cca8af59-54ba-4eab-b5c5-0f1a7926732c req-77a9323b-b53e-48e0-96ee-4c80db1a1c0c service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:58.951111 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-cca8af59-54ba-4eab-b5c5-0f1a7926732c req-77a9323b-b53e-48e0-96ee-4c80db1a1c0c service nova] Creating event network-vif-plugged:da2760ef-fd8b-466c-b2d5-110ab388fe82 for instance 848e70ee-4f74-46f4-bec6-84f3ec5a6309 on hv-cinder-78638 Apr 15 19:57:58.956414 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-cca8af59-54ba-4eab-b5c5-0f1a7926732c req-77a9323b-b53e-48e0-96ee-4c80db1a1c0c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.236105 Apr 15 19:57:58.957033 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 347/779] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:57:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:57:59.153784 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c73706c0-3351-4215-8092-f5fd1f0c2735 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:57:59.154341 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c73706c0-3351-4215-8092-f5fd1f0c2735 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: 848e70ee-4f74-46f4-bec6-84f3ec5a6309] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:57:59.162354 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c73706c0-3351-4215-8092-f5fd1f0c2735 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:59.163229 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c73706c0-3351-4215-8092-f5fd1f0c2735 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:59.165031 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c73706c0-3351-4215-8092-f5fd1f0c2735 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:57:59.165688 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c73706c0-3351-4215-8092-f5fd1f0c2735 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:57:59.376449 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c73706c0-3351-4215-8092-f5fd1f0c2735 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb2653fe9004615a5ecf575c999c2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bc040eb9af4c96ac478d1091ca1b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:57:59.385206 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c73706c0-3351-4215-8092-f5fd1f0c2735 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "GET /compute/v2.1/servers/848e70ee-4f74-46f4-bec6-84f3ec5a6309" status: 200 len: 1318 microversion: 2.1 time: 0.235668 Apr 15 19:57:59.385819 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 433/780] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:57:59 2021] GET /compute/v2.1/servers/848e70ee-4f74-46f4-bec6-84f3ec5a6309 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:58:00.403741 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-99bbc1fb-de26-4a0f-82f4-dd93c57bc16c tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:58:00.404516 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-99bbc1fb-de26-4a0f-82f4-dd93c57bc16c tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: 848e70ee-4f74-46f4-bec6-84f3ec5a6309] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:58:00.412580 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-99bbc1fb-de26-4a0f-82f4-dd93c57bc16c tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:00.413092 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-99bbc1fb-de26-4a0f-82f4-dd93c57bc16c tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:00.413927 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-99bbc1fb-de26-4a0f-82f4-dd93c57bc16c tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:00.414424 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-99bbc1fb-de26-4a0f-82f4-dd93c57bc16c tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:00.632269 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-99bbc1fb-de26-4a0f-82f4-dd93c57bc16c tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb2653fe9004615a5ecf575c999c2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bc040eb9af4c96ac478d1091ca1b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:58:00.641351 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-99bbc1fb-de26-4a0f-82f4-dd93c57bc16c tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "GET /compute/v2.1/servers/848e70ee-4f74-46f4-bec6-84f3ec5a6309" status: 200 len: 1318 microversion: 2.1 time: 0.242025 Apr 15 19:58:00.642170 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 348/781] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:58:00 2021] GET /compute/v2.1/servers/848e70ee-4f74-46f4-bec6-84f3ec5a6309 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:58:01.659189 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-02eaa72f-9b8d-4fdc-9e69-7df9eeb6593d tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:58:01.659910 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-02eaa72f-9b8d-4fdc-9e69-7df9eeb6593d tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: 848e70ee-4f74-46f4-bec6-84f3ec5a6309] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:58:01.668096 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-02eaa72f-9b8d-4fdc-9e69-7df9eeb6593d tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:01.668612 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-02eaa72f-9b8d-4fdc-9e69-7df9eeb6593d tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:01.669450 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-02eaa72f-9b8d-4fdc-9e69-7df9eeb6593d tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:01.669946 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-02eaa72f-9b8d-4fdc-9e69-7df9eeb6593d tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:01.881798 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-02eaa72f-9b8d-4fdc-9e69-7df9eeb6593d tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb2653fe9004615a5ecf575c999c2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bc040eb9af4c96ac478d1091ca1b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:58:01.890705 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-02eaa72f-9b8d-4fdc-9e69-7df9eeb6593d tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "GET /compute/v2.1/servers/848e70ee-4f74-46f4-bec6-84f3ec5a6309" status: 200 len: 1508 microversion: 2.1 time: 0.235576 Apr 15 19:58:01.891953 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 434/782] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:58:01 2021] GET /compute/v2.1/servers/848e70ee-4f74-46f4-bec6-84f3ec5a6309 => generated 1508 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:58:01.909694 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f7680d69-7fa1-4287-8164-116813df0f3f tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08f65084-8917-4759-97f0-23815454ae5c", "device": "/dev/sdb"}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:58:01.910835 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f7680d69-7fa1-4287-8164-116813df0f3f tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: 848e70ee-4f74-46f4-bec6-84f3ec5a6309] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:58:01.918997 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f7680d69-7fa1-4287-8164-116813df0f3f tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:01.919549 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f7680d69-7fa1-4287-8164-116813df0f3f tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:01.920412 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f7680d69-7fa1-4287-8164-116813df0f3f tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:01.920886 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f7680d69-7fa1-4287-8164-116813df0f3f tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:02.280089 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f7680d69-7fa1-4287-8164-116813df0f3f tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "POST /compute/v2.1/servers/848e70ee-4f74-46f4-bec6-84f3ec5a6309/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.374384 Apr 15 19:58:02.280759 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 349/783] 10.222.0.58 () {60 vars in 1313 bytes} [Thu Apr 15 19:58:01 2021] POST /compute/v2.1/servers/848e70ee-4f74-46f4-bec6-84f3ec5a6309/os-volume_attachments => generated 194 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:58:25.577105 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9d5d2f4a-56b2-4e83-b7f3-dc5f33bfa6a2 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:58:25.577653 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9d5d2f4a-56b2-4e83-b7f3-dc5f33bfa6a2 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: 848e70ee-4f74-46f4-bec6-84f3ec5a6309] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:58:25.585509 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9d5d2f4a-56b2-4e83-b7f3-dc5f33bfa6a2 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:25.586023 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9d5d2f4a-56b2-4e83-b7f3-dc5f33bfa6a2 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:25.586863 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9d5d2f4a-56b2-4e83-b7f3-dc5f33bfa6a2 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:25.587406 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9d5d2f4a-56b2-4e83-b7f3-dc5f33bfa6a2 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:25.760264 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.objects.instance [None req-9d5d2f4a-56b2-4e83-b7f3-dc5f33bfa6a2 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lazy-loading 'services' on Instance uuid 848e70ee-4f74-46f4-bec6-84f3ec5a6309 {{(pid=99511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 15 19:58:25.898498 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9d5d2f4a-56b2-4e83-b7f3-dc5f33bfa6a2 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "DELETE /compute/v2.1/servers/848e70ee-4f74-46f4-bec6-84f3ec5a6309/os-volume_attachments/08f65084-8917-4759-97f0-23815454ae5c" status: 202 len: 0 microversion: 2.1 time: 0.325447 Apr 15 19:58:25.899144 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 435/784] 10.222.0.58 () {58 vars in 1406 bytes} [Thu Apr 15 19:58:25 2021] DELETE /compute/v2.1/servers/848e70ee-4f74-46f4-bec6-84f3ec5a6309/os-volume_attachments/08f65084-8917-4759-97f0-23815454ae5c => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:58:27.108845 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d835afd8-379f-4f44-bf20-53fc3eb26415 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:58:27.109490 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d835afd8-379f-4f44-bf20-53fc3eb26415 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: 848e70ee-4f74-46f4-bec6-84f3ec5a6309] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:58:27.118758 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d835afd8-379f-4f44-bf20-53fc3eb26415 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:27.119264 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d835afd8-379f-4f44-bf20-53fc3eb26415 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:27.120112 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d835afd8-379f-4f44-bf20-53fc3eb26415 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:27.120600 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d835afd8-379f-4f44-bf20-53fc3eb26415 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:27.186981 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d835afd8-379f-4f44-bf20-53fc3eb26415 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: 848e70ee-4f74-46f4-bec6-84f3ec5a6309] Going to try to terminate instance {{(pid=99512) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 15 19:58:27.298301 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d835afd8-379f-4f44-bf20-53fc3eb26415 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "DELETE /compute/v2.1/servers/848e70ee-4f74-46f4-bec6-84f3ec5a6309" status: 204 len: 0 microversion: 2.1 time: 0.193598 Apr 15 19:58:27.298929 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 350/785] 10.222.0.58 () {58 vars in 1229 bytes} [Thu Apr 15 19:58:27 2021] DELETE /compute/v2.1/servers/848e70ee-4f74-46f4-bec6-84f3ec5a6309 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 15 19:58:27.308375 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b0e0a579-924a-4378-a372-41c6d08724ec tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:58:27.309139 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b0e0a579-924a-4378-a372-41c6d08724ec tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: 848e70ee-4f74-46f4-bec6-84f3ec5a6309] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:58:27.317104 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b0e0a579-924a-4378-a372-41c6d08724ec tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:27.317610 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b0e0a579-924a-4378-a372-41c6d08724ec tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:27.318431 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b0e0a579-924a-4378-a372-41c6d08724ec tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:27.318920 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b0e0a579-924a-4378-a372-41c6d08724ec tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:27.534854 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b0e0a579-924a-4378-a372-41c6d08724ec tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb2653fe9004615a5ecf575c999c2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bc040eb9af4c96ac478d1091ca1b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:58:27.544020 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b0e0a579-924a-4378-a372-41c6d08724ec tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "GET /compute/v2.1/servers/848e70ee-4f74-46f4-bec6-84f3ec5a6309" status: 200 len: 1514 microversion: 2.1 time: 0.240149 Apr 15 19:58:27.544627 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 436/786] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:58:27 2021] GET /compute/v2.1/servers/848e70ee-4f74-46f4-bec6-84f3ec5a6309 => generated 1514 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:58:28.562913 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a364c66f-2fac-4a41-8b09-735ecf944689 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:58:28.563716 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a364c66f-2fac-4a41-8b09-735ecf944689 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: 848e70ee-4f74-46f4-bec6-84f3ec5a6309] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:58:28.571776 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a364c66f-2fac-4a41-8b09-735ecf944689 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:28.572289 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a364c66f-2fac-4a41-8b09-735ecf944689 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:28.573120 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a364c66f-2fac-4a41-8b09-735ecf944689 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:28.573613 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a364c66f-2fac-4a41-8b09-735ecf944689 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:28.786445 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a364c66f-2fac-4a41-8b09-735ecf944689 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb2653fe9004615a5ecf575c999c2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bc040eb9af4c96ac478d1091ca1b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:58:28.796197 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a364c66f-2fac-4a41-8b09-735ecf944689 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "GET /compute/v2.1/servers/848e70ee-4f74-46f4-bec6-84f3ec5a6309" status: 200 len: 1514 microversion: 2.1 time: 0.237808 Apr 15 19:58:28.796821 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 351/787] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:58:28 2021] GET /compute/v2.1/servers/848e70ee-4f74-46f4-bec6-84f3ec5a6309 => generated 1514 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:58:29.814112 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ff285099-ac85-437e-b0c9-11e25a88a2b8 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:58:29.814785 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ff285099-ac85-437e-b0c9-11e25a88a2b8 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: 848e70ee-4f74-46f4-bec6-84f3ec5a6309] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:58:29.823147 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ff285099-ac85-437e-b0c9-11e25a88a2b8 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:29.823660 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ff285099-ac85-437e-b0c9-11e25a88a2b8 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:29.824498 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ff285099-ac85-437e-b0c9-11e25a88a2b8 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:29.824990 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ff285099-ac85-437e-b0c9-11e25a88a2b8 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:30.193137 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ff285099-ac85-437e-b0c9-11e25a88a2b8 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb2653fe9004615a5ecf575c999c2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53bc040eb9af4c96ac478d1091ca1b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:58:30.202990 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ff285099-ac85-437e-b0c9-11e25a88a2b8 tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "GET /compute/v2.1/servers/848e70ee-4f74-46f4-bec6-84f3ec5a6309" status: 200 len: 1514 microversion: 2.1 time: 0.392881 Apr 15 19:58:30.203869 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 437/788] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:58:29 2021] GET /compute/v2.1/servers/848e70ee-4f74-46f4-bec6-84f3ec5a6309 => generated 1514 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:58:30.464636 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-81a92248-edbb-40b6-85c3-b9f943b2c37c req-8c03390f-edde-445f-83db-dc2573bd17b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "848e70ee-4f74-46f4-bec6-84f3ec5a6309", "name": "network-vif-deleted", "tag": "da2760ef-fd8b-466c-b2d5-110ab388fe82"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:58:30.466409 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:58:30.466409 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:58:30.476351 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-81a92248-edbb-40b6-85c3-b9f943b2c37c req-8c03390f-edde-445f-83db-dc2573bd17b2 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:30.476890 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-81a92248-edbb-40b6-85c3-b9f943b2c37c req-8c03390f-edde-445f-83db-dc2573bd17b2 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:30.495336 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-81a92248-edbb-40b6-85c3-b9f943b2c37c req-8c03390f-edde-445f-83db-dc2573bd17b2 service nova] Creating event network-vif-deleted:da2760ef-fd8b-466c-b2d5-110ab388fe82 for instance 848e70ee-4f74-46f4-bec6-84f3ec5a6309 on hv-cinder-78638 Apr 15 19:58:30.500581 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-81a92248-edbb-40b6-85c3-b9f943b2c37c req-8c03390f-edde-445f-83db-dc2573bd17b2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039932 Apr 15 19:58:30.501291 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 352/789] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:58:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:58:31.221619 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6dfb582d-7ac8-47df-a6d5-b210e744700c tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:58:31.222346 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6dfb582d-7ac8-47df-a6d5-b210e744700c tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] [instance: 848e70ee-4f74-46f4-bec6-84f3ec5a6309] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:58:31.230554 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6dfb582d-7ac8-47df-a6d5-b210e744700c tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:31.231069 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6dfb582d-7ac8-47df-a6d5-b210e744700c tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:31.231968 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6dfb582d-7ac8-47df-a6d5-b210e744700c tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:31.232464 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6dfb582d-7ac8-47df-a6d5-b210e744700c tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:31.287254 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-6dfb582d-7ac8-47df-a6d5-b210e744700c tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] HTTP exception thrown: Instance 848e70ee-4f74-46f4-bec6-84f3ec5a6309 could not be found. Apr 15 19:58:31.287952 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6dfb582d-7ac8-47df-a6d5-b210e744700c tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] Returning 404 to user: Instance 848e70ee-4f74-46f4-bec6-84f3ec5a6309 could not be found. {{(pid=99511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 19:58:31.289811 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6dfb582d-7ac8-47df-a6d5-b210e744700c tempest-VolumesSnapshotTestJSON-1201389932 tempest-VolumesSnapshotTestJSON-1201389932-project] 10.222.0.58 "GET /compute/v2.1/servers/848e70ee-4f74-46f4-bec6-84f3ec5a6309" status: 404 len: 111 microversion: 2.1 time: 0.072242 Apr 15 19:58:31.290441 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 438/790] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:58:31 2021] GET /compute/v2.1/servers/848e70ee-4f74-46f4-bec6-84f3ec5a6309 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 15 19:58:44.016469 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 15 19:58:44.016986 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: Thu Apr 15 19:58:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 15 19:58:48.266065 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-1958366a-c63e-4750-8ec1-7964bb56df49 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:58:48.266711 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-1958366a-c63e-4750-8ec1-7964bb56df49 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:58:48.275517 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1958366a-c63e-4750-8ec1-7964bb56df49 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:48.276046 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1958366a-c63e-4750-8ec1-7964bb56df49 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:48.276863 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1958366a-c63e-4750-8ec1-7964bb56df49 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:48.277358 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1958366a-c63e-4750-8ec1-7964bb56df49 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:48.472609 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.objects.instance [None req-1958366a-c63e-4750-8ec1-7964bb56df49 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lazy-loading 'services' on Instance uuid 271550cc-6d60-4503-9d82-cbf32efbd5d9 {{(pid=99512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 15 19:58:48.643460 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-1958366a-c63e-4750-8ec1-7964bb56df49 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "DELETE /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/os-volume_attachments/fef82769-d345-4b27-944b-aa6ad13e9fc2" status: 202 len: 0 microversion: 2.1 time: 0.499221 Apr 15 19:58:48.644265 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 353/791] 10.222.0.58 () {58 vars in 1406 bytes} [Thu Apr 15 19:58:48 2021] DELETE /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/os-volume_attachments/fef82769-d345-4b27-944b-aa6ad13e9fc2 => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:58:49.867682 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e3b26760-5454-4136-abfd-121ff74912a7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:58:49.875462 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e3b26760-5454-4136-abfd-121ff74912a7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:49.875971 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e3b26760-5454-4136-abfd-121ff74912a7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:49.943933 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e3b26760-5454-4136-abfd-121ff74912a7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Going to try to stop instance {{(pid=99511) force_stop /opt/stack/nova/nova/compute/api.py:2604}} Apr 15 19:58:50.046960 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e3b26760-5454-4136-abfd-121ff74912a7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 202 len: 0 microversion: 2.1 time: 0.183485 Apr 15 19:58:50.047672 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 439/792] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:58:49 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:58:50.057813 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f32a35bf-4125-4120-ae3c-9d2212736148 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:58:50.058681 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f32a35bf-4125-4120-ae3c-9d2212736148 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:58:50.068192 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f32a35bf-4125-4120-ae3c-9d2212736148 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:50.068856 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f32a35bf-4125-4120-ae3c-9d2212736148 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:50.069911 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f32a35bf-4125-4120-ae3c-9d2212736148 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:50.070131 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f32a35bf-4125-4120-ae3c-9d2212736148 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:50.304874 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f32a35bf-4125-4120-ae3c-9d2212736148 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:58:50.313743 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f32a35bf-4125-4120-ae3c-9d2212736148 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1675 microversion: 2.1 time: 0.261203 Apr 15 19:58:50.314444 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 354/793] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:58:50 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1675 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:58:51.333964 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6d9de39f-f800-46e0-a823-cf99c2fc4066 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:58:51.335380 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6d9de39f-f800-46e0-a823-cf99c2fc4066 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:58:51.343531 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6d9de39f-f800-46e0-a823-cf99c2fc4066 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:51.344039 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6d9de39f-f800-46e0-a823-cf99c2fc4066 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:51.344868 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6d9de39f-f800-46e0-a823-cf99c2fc4066 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:51.345359 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6d9de39f-f800-46e0-a823-cf99c2fc4066 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:51.587147 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-6d9de39f-f800-46e0-a823-cf99c2fc4066 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:58:51.596727 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6d9de39f-f800-46e0-a823-cf99c2fc4066 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1675 microversion: 2.1 time: 0.267303 Apr 15 19:58:51.597520 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 440/794] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:58:51 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1675 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:58:52.043422 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 15 19:58:52.043643 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: Thu Apr 15 19:58:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 15 19:58:52.616345 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9a79d079-a5a1-412f-972c-5072ba3ad437 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:58:52.617087 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9a79d079-a5a1-412f-972c-5072ba3ad437 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:58:52.625233 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9a79d079-a5a1-412f-972c-5072ba3ad437 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:52.625779 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9a79d079-a5a1-412f-972c-5072ba3ad437 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:52.626703 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9a79d079-a5a1-412f-972c-5072ba3ad437 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:52.627184 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9a79d079-a5a1-412f-972c-5072ba3ad437 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:52.855409 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9a79d079-a5a1-412f-972c-5072ba3ad437 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:58:52.865508 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9a79d079-a5a1-412f-972c-5072ba3ad437 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1675 microversion: 2.1 time: 0.253769 Apr 15 19:58:52.866761 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 355/795] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:58:52 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1675 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:58:53.885264 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ff0beb9c-9a36-4d7e-8d40-e2befaeb7a85 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:58:53.885944 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ff0beb9c-9a36-4d7e-8d40-e2befaeb7a85 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:58:53.894000 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ff0beb9c-9a36-4d7e-8d40-e2befaeb7a85 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:53.894524 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ff0beb9c-9a36-4d7e-8d40-e2befaeb7a85 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:53.895400 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ff0beb9c-9a36-4d7e-8d40-e2befaeb7a85 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:53.895905 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ff0beb9c-9a36-4d7e-8d40-e2befaeb7a85 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:54.127825 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ff0beb9c-9a36-4d7e-8d40-e2befaeb7a85 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:58:54.137498 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ff0beb9c-9a36-4d7e-8d40-e2befaeb7a85 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1675 microversion: 2.1 time: 0.256785 Apr 15 19:58:54.138069 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 441/796] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:58:53 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1675 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:58:54.610398 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-273bd684-fee6-44cd-95fb-e3099ab25214 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:58:54.611519 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-273bd684-fee6-44cd-95fb-e3099ab25214 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:58:54.620093 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-273bd684-fee6-44cd-95fb-e3099ab25214 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:54.620593 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-273bd684-fee6-44cd-95fb-e3099ab25214 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:54.621435 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-273bd684-fee6-44cd-95fb-e3099ab25214 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:54.621935 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-273bd684-fee6-44cd-95fb-e3099ab25214 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:54.787346 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-273bd684-fee6-44cd-95fb-e3099ab25214 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "POST /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453/action" status: 202 len: 0 microversion: 2.1 time: 0.180807 Apr 15 19:58:54.788710 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 356/797] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:58:54 2021] POST /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:58:54.801694 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f3554497-a326-4bdd-aebe-30f70b098ba1 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:58:54.803007 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f3554497-a326-4bdd-aebe-30f70b098ba1 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:58:54.816639 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f3554497-a326-4bdd-aebe-30f70b098ba1 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:54.817338 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f3554497-a326-4bdd-aebe-30f70b098ba1 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:54.818275 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f3554497-a326-4bdd-aebe-30f70b098ba1 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:54.818916 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f3554497-a326-4bdd-aebe-30f70b098ba1 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:55.160417 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9a790691-26ec-4b1e-9d87-b0120229115c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:58:55.161878 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9a790691-26ec-4b1e-9d87-b0120229115c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:58:55.175354 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9a790691-26ec-4b1e-9d87-b0120229115c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:55.176056 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9a790691-26ec-4b1e-9d87-b0120229115c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:55.177310 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9a790691-26ec-4b1e-9d87-b0120229115c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:55.178022 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9a790691-26ec-4b1e-9d87-b0120229115c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:55.499547 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f3554497-a326-4bdd-aebe-30f70b098ba1 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:58:55.509953 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f3554497-a326-4bdd-aebe-30f70b098ba1 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1752 microversion: 2.1 time: 0.716102 Apr 15 19:58:55.510586 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 442/798] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:58:54 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1752 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:58:55.697943 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9a790691-26ec-4b1e-9d87-b0120229115c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:58:55.707781 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9a790691-26ec-4b1e-9d87-b0120229115c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1675 microversion: 2.1 time: 0.554670 Apr 15 19:58:55.708517 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 357/799] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:58:55 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1675 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:58:56.542539 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7a3a4526-f3de-4b17-b74b-bb28f27508e4 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:58:56.543213 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7a3a4526-f3de-4b17-b74b-bb28f27508e4 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:58:56.551141 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7a3a4526-f3de-4b17-b74b-bb28f27508e4 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:56.551695 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7a3a4526-f3de-4b17-b74b-bb28f27508e4 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:56.552559 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7a3a4526-f3de-4b17-b74b-bb28f27508e4 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:56.553096 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7a3a4526-f3de-4b17-b74b-bb28f27508e4 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:56.726451 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f42b5bcc-b47b-4acc-bcc1-70d099363de7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:58:56.727128 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f42b5bcc-b47b-4acc-bcc1-70d099363de7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:58:56.735780 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f42b5bcc-b47b-4acc-bcc1-70d099363de7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:56.736296 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f42b5bcc-b47b-4acc-bcc1-70d099363de7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:56.737141 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f42b5bcc-b47b-4acc-bcc1-70d099363de7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:56.737657 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f42b5bcc-b47b-4acc-bcc1-70d099363de7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:56.777395 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-7a3a4526-f3de-4b17-b74b-bb28f27508e4 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:58:56.787168 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7a3a4526-f3de-4b17-b74b-bb28f27508e4 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1757 microversion: 2.1 time: 0.249643 Apr 15 19:58:56.787903 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 443/800] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:58:56 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1757 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:58:56.962735 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f42b5bcc-b47b-4acc-bcc1-70d099363de7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:58:56.971549 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f42b5bcc-b47b-4acc-bcc1-70d099363de7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1675 microversion: 2.1 time: 0.249279 Apr 15 19:58:56.972171 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 358/801] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:58:56 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1675 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:58:57.806093 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e3e9be90-7c99-46a6-aa94-96a3ef72296a tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:58:57.806763 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e3e9be90-7c99-46a6-aa94-96a3ef72296a tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:58:57.814529 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e3e9be90-7c99-46a6-aa94-96a3ef72296a tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:57.815041 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e3e9be90-7c99-46a6-aa94-96a3ef72296a tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:57.815900 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e3e9be90-7c99-46a6-aa94-96a3ef72296a tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:57.816388 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e3e9be90-7c99-46a6-aa94-96a3ef72296a tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:57.990486 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-470a606a-11a6-4ac0-99c1-6eeabeab296b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:58:57.991254 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-470a606a-11a6-4ac0-99c1-6eeabeab296b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:58:58.000552 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-470a606a-11a6-4ac0-99c1-6eeabeab296b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:58.001311 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-470a606a-11a6-4ac0-99c1-6eeabeab296b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:58.002253 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-470a606a-11a6-4ac0-99c1-6eeabeab296b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:58.002831 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-470a606a-11a6-4ac0-99c1-6eeabeab296b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:58.048978 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-e3e9be90-7c99-46a6-aa94-96a3ef72296a tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:58:58.059218 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e3e9be90-7c99-46a6-aa94-96a3ef72296a tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1757 microversion: 2.1 time: 0.256641 Apr 15 19:58:58.059395 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 444/802] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:58:57 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1757 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:58:58.254698 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-470a606a-11a6-4ac0-99c1-6eeabeab296b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:58:58.264109 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-470a606a-11a6-4ac0-99c1-6eeabeab296b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1675 microversion: 2.1 time: 0.278247 Apr 15 19:58:58.264736 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 359/803] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:58:57 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1675 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:58:59.077781 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-18bbc9e8-ecf6-492f-992c-6c0fe2a9d5f6 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:58:59.078449 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-18bbc9e8-ecf6-492f-992c-6c0fe2a9d5f6 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:58:59.087002 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-18bbc9e8-ecf6-492f-992c-6c0fe2a9d5f6 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:59.087563 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-18bbc9e8-ecf6-492f-992c-6c0fe2a9d5f6 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:59.088405 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-18bbc9e8-ecf6-492f-992c-6c0fe2a9d5f6 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:59.088894 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-18bbc9e8-ecf6-492f-992c-6c0fe2a9d5f6 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:59.282231 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9edc3e2f-60d9-4135-9493-1a22b538505e tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:58:59.282911 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9edc3e2f-60d9-4135-9493-1a22b538505e tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:58:59.292412 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9edc3e2f-60d9-4135-9493-1a22b538505e tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:59.292932 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9edc3e2f-60d9-4135-9493-1a22b538505e tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:59.293982 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9edc3e2f-60d9-4135-9493-1a22b538505e tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:58:59.294722 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9edc3e2f-60d9-4135-9493-1a22b538505e tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:58:59.375745 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-18bbc9e8-ecf6-492f-992c-6c0fe2a9d5f6 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:58:59.385280 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-18bbc9e8-ecf6-492f-992c-6c0fe2a9d5f6 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1757 microversion: 2.1 time: 0.311592 Apr 15 19:58:59.386264 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 445/804] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:58:59 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1757 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:58:59.724450 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9edc3e2f-60d9-4135-9493-1a22b538505e tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:58:59.734133 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9edc3e2f-60d9-4135-9493-1a22b538505e tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1675 microversion: 2.1 time: 0.456042 Apr 15 19:58:59.734778 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 360/805] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:58:59 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1675 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:59:00.404424 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b77df71d-58bc-447f-b75c-6100b7125c44 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:59:00.405383 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b77df71d-58bc-447f-b75c-6100b7125c44 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:00.414357 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b77df71d-58bc-447f-b75c-6100b7125c44 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:00.414873 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b77df71d-58bc-447f-b75c-6100b7125c44 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:00.415746 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b77df71d-58bc-447f-b75c-6100b7125c44 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:00.416244 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b77df71d-58bc-447f-b75c-6100b7125c44 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:00.637959 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b77df71d-58bc-447f-b75c-6100b7125c44 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:00.648090 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b77df71d-58bc-447f-b75c-6100b7125c44 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1757 microversion: 2.1 time: 0.247787 Apr 15 19:59:00.648709 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 446/806] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:59:00 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1757 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:59:00.753106 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ce3081e5-eba6-4bb3-b766-34c6406adb36 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:59:00.753774 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ce3081e5-eba6-4bb3-b766-34c6406adb36 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:00.762140 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ce3081e5-eba6-4bb3-b766-34c6406adb36 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:00.762645 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ce3081e5-eba6-4bb3-b766-34c6406adb36 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:00.763501 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ce3081e5-eba6-4bb3-b766-34c6406adb36 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:00.763994 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ce3081e5-eba6-4bb3-b766-34c6406adb36 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:00.896484 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 15 19:59:00.896725 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: Thu Apr 15 19:59:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 15 19:59:00.982494 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ce3081e5-eba6-4bb3-b766-34c6406adb36 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:00.992198 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ce3081e5-eba6-4bb3-b766-34c6406adb36 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1652 microversion: 2.1 time: 0.243127 Apr 15 19:59:00.992818 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 361/807] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:59:00 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1652 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:59:01.010291 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-281496fc-605d-4c8d-ac08-5d5f3aba0b79 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:59:01.018260 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-281496fc-605d-4c8d-ac08-5d5f3aba0b79 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:01.018781 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-281496fc-605d-4c8d-ac08-5d5f3aba0b79 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:01.079505 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-281496fc-605d-4c8d-ac08-5d5f3aba0b79 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Going to try to start instance {{(pid=99511) start /opt/stack/nova/nova/compute/api.py:2627}} Apr 15 19:59:01.157374 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-281496fc-605d-4c8d-ac08-5d5f3aba0b79 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action" status: 202 len: 0 microversion: 2.1 time: 0.151507 Apr 15 19:59:01.158253 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 447/808] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 19:59:01 2021] POST /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:59:01.167647 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-037f6659-86d8-455a-9c71-54a1b5f549ce tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:59:01.168456 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-037f6659-86d8-455a-9c71-54a1b5f549ce tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:01.177488 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-037f6659-86d8-455a-9c71-54a1b5f549ce tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:01.178587 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-037f6659-86d8-455a-9c71-54a1b5f549ce tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:01.180078 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-037f6659-86d8-455a-9c71-54a1b5f549ce tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:01.180592 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-037f6659-86d8-455a-9c71-54a1b5f549ce tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:01.543248 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-037f6659-86d8-455a-9c71-54a1b5f549ce tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:01.553397 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-037f6659-86d8-455a-9c71-54a1b5f549ce tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1661 microversion: 2.1 time: 0.390690 Apr 15 19:59:01.554035 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 362/809] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:59:01 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1661 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:59:01.668074 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-4d5e65a9-e68c-4142-a69e-27f28c213f1d tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:59:01.669340 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-4d5e65a9-e68c-4142-a69e-27f28c213f1d tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:01.677922 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4d5e65a9-e68c-4142-a69e-27f28c213f1d tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:01.678651 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4d5e65a9-e68c-4142-a69e-27f28c213f1d tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:01.679919 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4d5e65a9-e68c-4142-a69e-27f28c213f1d tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:01.680562 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4d5e65a9-e68c-4142-a69e-27f28c213f1d tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:01.998071 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-4d5e65a9-e68c-4142-a69e-27f28c213f1d tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:02.008670 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-4d5e65a9-e68c-4142-a69e-27f28c213f1d tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1757 microversion: 2.1 time: 0.345858 Apr 15 19:59:02.016136 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 448/810] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:59:01 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1757 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:59:02.573577 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-757f0961-0ded-47ca-9cef-41694c2c01ee tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:59:02.573577 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-757f0961-0ded-47ca-9cef-41694c2c01ee tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:02.581495 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-757f0961-0ded-47ca-9cef-41694c2c01ee tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:02.584712 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-757f0961-0ded-47ca-9cef-41694c2c01ee tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:02.584712 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-757f0961-0ded-47ca-9cef-41694c2c01ee tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:02.584712 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-757f0961-0ded-47ca-9cef-41694c2c01ee tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:03.027704 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f4999819-9d06-4c03-99fe-1b37566fe5b6 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:59:03.028379 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f4999819-9d06-4c03-99fe-1b37566fe5b6 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:03.036169 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f4999819-9d06-4c03-99fe-1b37566fe5b6 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:03.036654 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f4999819-9d06-4c03-99fe-1b37566fe5b6 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:03.037490 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f4999819-9d06-4c03-99fe-1b37566fe5b6 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:03.037978 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f4999819-9d06-4c03-99fe-1b37566fe5b6 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:03.058913 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-757f0961-0ded-47ca-9cef-41694c2c01ee tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:03.069054 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-757f0961-0ded-47ca-9cef-41694c2c01ee tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1661 microversion: 2.1 time: 0.500318 Apr 15 19:59:03.069701 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 363/811] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:59:02 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1661 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:59:03.272071 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f4999819-9d06-4c03-99fe-1b37566fe5b6 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:03.281599 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f4999819-9d06-4c03-99fe-1b37566fe5b6 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1757 microversion: 2.1 time: 0.257912 Apr 15 19:59:03.282347 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 449/812] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:59:03 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1757 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 19:59:04.088417 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-df49d669-86a2-46b2-8971-b97c5ba710d3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:59:04.089139 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-df49d669-86a2-46b2-8971-b97c5ba710d3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:04.097258 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-df49d669-86a2-46b2-8971-b97c5ba710d3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:04.097766 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-df49d669-86a2-46b2-8971-b97c5ba710d3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:04.098605 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-df49d669-86a2-46b2-8971-b97c5ba710d3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:04.099097 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-df49d669-86a2-46b2-8971-b97c5ba710d3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:04.301703 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-23d797a3-3915-4175-974f-a16977895204 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:59:04.302812 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-23d797a3-3915-4175-974f-a16977895204 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:04.314399 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-23d797a3-3915-4175-974f-a16977895204 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:04.315163 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-23d797a3-3915-4175-974f-a16977895204 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:04.316399 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-23d797a3-3915-4175-974f-a16977895204 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:04.317194 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-23d797a3-3915-4175-974f-a16977895204 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:04.359203 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-df49d669-86a2-46b2-8971-b97c5ba710d3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:04.369876 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-df49d669-86a2-46b2-8971-b97c5ba710d3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1665 microversion: 2.1 time: 0.286079 Apr 15 19:59:04.370742 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 364/813] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:59:04 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1665 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:59:04.565679 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-23d797a3-3915-4175-974f-a16977895204 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:04.575366 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-23d797a3-3915-4175-974f-a16977895204 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1757 microversion: 2.1 time: 0.278192 Apr 15 19:59:04.575994 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 450/814] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:59:04 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1757 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:59:04.698912 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6bb5f300-e64a-457d-ac46-c0265502ef24 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:59:04.699489 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6bb5f300-e64a-457d-ac46-c0265502ef24 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:04.708065 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6bb5f300-e64a-457d-ac46-c0265502ef24 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:04.708652 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6bb5f300-e64a-457d-ac46-c0265502ef24 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:04.710117 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6bb5f300-e64a-457d-ac46-c0265502ef24 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:04.710616 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6bb5f300-e64a-457d-ac46-c0265502ef24 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:04.779819 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6bb5f300-e64a-457d-ac46-c0265502ef24 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/os-volume_attachments/ee4f1852-b29a-4aac-840a-7d5e7cfe52b2" status: 200 len: 194 microversion: 2.20 time: 0.085050 Apr 15 19:59:04.780469 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 365/815] 10.222.0.58 () {60 vars in 1444 bytes} [Thu Apr 15 19:59:04 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/os-volume_attachments/ee4f1852-b29a-4aac-840a-7d5e7cfe52b2 => generated 194 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:59:04.904438 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c770adb2-beec-4a49-9b03-ada585c93569 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:59:04.904984 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c770adb2-beec-4a49-9b03-ada585c93569 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:04.912936 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c770adb2-beec-4a49-9b03-ada585c93569 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:04.913439 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c770adb2-beec-4a49-9b03-ada585c93569 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:04.914562 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c770adb2-beec-4a49-9b03-ada585c93569 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:04.915051 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c770adb2-beec-4a49-9b03-ada585c93569 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:05.092948 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.objects.instance [None req-c770adb2-beec-4a49-9b03-ada585c93569 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lazy-loading 'services' on Instance uuid 6c0ac4cf-7982-406b-a2f0-115ca5721a10 {{(pid=99511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 15 19:59:05.240657 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c770adb2-beec-4a49-9b03-ada585c93569 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/os-volume_attachments/ee4f1852-b29a-4aac-840a-7d5e7cfe52b2" status: 202 len: 0 microversion: 2.20 time: 0.339428 Apr 15 19:59:05.241312 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 451/816] 10.222.0.58 () {60 vars in 1447 bytes} [Thu Apr 15 19:59:04 2021] DELETE /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10/os-volume_attachments/ee4f1852-b29a-4aac-840a-7d5e7cfe52b2 => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 15 19:59:05.594863 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-265065e5-75d7-47b0-8124-3963b8330277 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:59:05.595549 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-265065e5-75d7-47b0-8124-3963b8330277 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:05.605889 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-265065e5-75d7-47b0-8124-3963b8330277 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:05.606402 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-265065e5-75d7-47b0-8124-3963b8330277 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:05.607252 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-265065e5-75d7-47b0-8124-3963b8330277 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:05.607770 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-265065e5-75d7-47b0-8124-3963b8330277 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:05.826606 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-265065e5-75d7-47b0-8124-3963b8330277 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:05.836225 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-265065e5-75d7-47b0-8124-3963b8330277 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1757 microversion: 2.1 time: 0.245600 Apr 15 19:59:05.836838 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 366/817] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:59:05 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1757 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:59:06.466198 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b948be27-6fc0-4bac-807b-aae1abe83176 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:59:06.466856 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b948be27-6fc0-4bac-807b-aae1abe83176 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:06.475159 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b948be27-6fc0-4bac-807b-aae1abe83176 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:06.475699 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b948be27-6fc0-4bac-807b-aae1abe83176 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:06.476555 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b948be27-6fc0-4bac-807b-aae1abe83176 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:06.477046 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b948be27-6fc0-4bac-807b-aae1abe83176 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:06.542524 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b948be27-6fc0-4bac-807b-aae1abe83176 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Going to try to terminate instance {{(pid=99511) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 15 19:59:06.657722 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b948be27-6fc0-4bac-807b-aae1abe83176 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 204 len: 0 microversion: 2.20 time: 0.195768 Apr 15 19:59:06.658560 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 452/818] 10.222.0.58 () {60 vars in 1270 bytes} [Thu Apr 15 19:59:06 2021] DELETE /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 15 19:59:06.667833 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-cef94e0b-36d1-4173-b3d8-80c29e6fd8ab tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:59:06.668477 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-cef94e0b-36d1-4173-b3d8-80c29e6fd8ab tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:06.676324 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cef94e0b-36d1-4173-b3d8-80c29e6fd8ab tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:06.676880 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cef94e0b-36d1-4173-b3d8-80c29e6fd8ab tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:06.678138 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cef94e0b-36d1-4173-b3d8-80c29e6fd8ab tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:06.678631 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cef94e0b-36d1-4173-b3d8-80c29e6fd8ab tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:06.854964 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a259af0b-5522-4b09-8578-25c2b1d8f8f0 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:59:06.856039 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a259af0b-5522-4b09-8578-25c2b1d8f8f0 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:06.864129 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a259af0b-5522-4b09-8578-25c2b1d8f8f0 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:06.864737 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a259af0b-5522-4b09-8578-25c2b1d8f8f0 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:06.866143 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a259af0b-5522-4b09-8578-25c2b1d8f8f0 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:06.866630 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a259af0b-5522-4b09-8578-25c2b1d8f8f0 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:06.902084 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-cef94e0b-36d1-4173-b3d8-80c29e6fd8ab tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:06.911867 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-cef94e0b-36d1-4173-b3d8-80c29e6fd8ab tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:06.913981 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-cef94e0b-36d1-4173-b3d8-80c29e6fd8ab tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:06.915193 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-cef94e0b-36d1-4173-b3d8-80c29e6fd8ab tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1725 microversion: 2.20 time: 0.251906 Apr 15 19:59:06.916065 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 367/819] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:59:06 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1725 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 19:59:07.106411 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a259af0b-5522-4b09-8578-25c2b1d8f8f0 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:07.116479 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a259af0b-5522-4b09-8578-25c2b1d8f8f0 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1757 microversion: 2.1 time: 0.265963 Apr 15 19:59:07.117091 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 453/820] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:59:06 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1757 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:59:07.935156 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-df947672-e305-4018-85e9-f9c4e008ec81 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:59:07.935864 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-df947672-e305-4018-85e9-f9c4e008ec81 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:07.944458 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-df947672-e305-4018-85e9-f9c4e008ec81 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:07.944966 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-df947672-e305-4018-85e9-f9c4e008ec81 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:07.945819 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-df947672-e305-4018-85e9-f9c4e008ec81 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:07.946317 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-df947672-e305-4018-85e9-f9c4e008ec81 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:08.134830 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b3722581-c83e-4277-b5e6-428e0e58c521 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:59:08.135584 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b3722581-c83e-4277-b5e6-428e0e58c521 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:08.143757 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b3722581-c83e-4277-b5e6-428e0e58c521 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:08.144277 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b3722581-c83e-4277-b5e6-428e0e58c521 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:08.145172 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b3722581-c83e-4277-b5e6-428e0e58c521 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:08.145670 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b3722581-c83e-4277-b5e6-428e0e58c521 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:08.166179 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-df947672-e305-4018-85e9-f9c4e008ec81 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:08.175927 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-df947672-e305-4018-85e9-f9c4e008ec81 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:08.178076 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-df947672-e305-4018-85e9-f9c4e008ec81 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:08.179312 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-df947672-e305-4018-85e9-f9c4e008ec81 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1725 microversion: 2.20 time: 0.248467 Apr 15 19:59:08.179976 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 368/821] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:59:07 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1725 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:59:08.362553 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b3722581-c83e-4277-b5e6-428e0e58c521 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:08.372566 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b3722581-c83e-4277-b5e6-428e0e58c521 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1760 microversion: 2.1 time: 0.242234 Apr 15 19:59:08.373300 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 454/822] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 19:59:08 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1760 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:59:09.198702 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-da5e1bd3-6e21-421c-bdf3-f8d8f9b3db66 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:59:09.199396 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-da5e1bd3-6e21-421c-bdf3-f8d8f9b3db66 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:09.207392 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-da5e1bd3-6e21-421c-bdf3-f8d8f9b3db66 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:09.207906 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-da5e1bd3-6e21-421c-bdf3-f8d8f9b3db66 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:09.208755 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-da5e1bd3-6e21-421c-bdf3-f8d8f9b3db66 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:09.209740 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-da5e1bd3-6e21-421c-bdf3-f8d8f9b3db66 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:09.565389 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-da5e1bd3-6e21-421c-bdf3-f8d8f9b3db66 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:09.576646 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-da5e1bd3-6e21-421c-bdf3-f8d8f9b3db66 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:09.578309 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-da5e1bd3-6e21-421c-bdf3-f8d8f9b3db66 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:09.579590 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-da5e1bd3-6e21-421c-bdf3-f8d8f9b3db66 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1725 microversion: 2.20 time: 0.384968 Apr 15 19:59:09.580205 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 369/823] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:59:09 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1725 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:59:10.242176 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-cb610d77-31bb-46f8-9c7f-41d1ff45b5d0 req-0cd0de45-b5f0-4b07-83d4-a57649574475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0ac4cf-7982-406b-a2f0-115ca5721a10", "name": "network-vif-deleted", "tag": "431c18ae-c617-4e1e-bca6-7134661c98e1"}]} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:59:10.244219 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:59:10.244219 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:59:10.253457 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-cb610d77-31bb-46f8-9c7f-41d1ff45b5d0 req-0cd0de45-b5f0-4b07-83d4-a57649574475 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:10.253971 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-cb610d77-31bb-46f8-9c7f-41d1ff45b5d0 req-0cd0de45-b5f0-4b07-83d4-a57649574475 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:10.273536 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-cb610d77-31bb-46f8-9c7f-41d1ff45b5d0 req-0cd0de45-b5f0-4b07-83d4-a57649574475 service nova] Creating event network-vif-deleted:431c18ae-c617-4e1e-bca6-7134661c98e1 for instance 6c0ac4cf-7982-406b-a2f0-115ca5721a10 on hv-cinder-78638 Apr 15 19:59:10.279134 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-cb610d77-31bb-46f8-9c7f-41d1ff45b5d0 req-0cd0de45-b5f0-4b07-83d4-a57649574475 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042722 Apr 15 19:59:10.280163 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 455/824] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:59:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:59:10.601884 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-4ed7972d-95c6-4037-bb9e-e28eefdb0896 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:59:10.602559 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-4ed7972d-95c6-4037-bb9e-e28eefdb0896 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:10.611951 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4ed7972d-95c6-4037-bb9e-e28eefdb0896 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:10.612471 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4ed7972d-95c6-4037-bb9e-e28eefdb0896 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:10.613763 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4ed7972d-95c6-4037-bb9e-e28eefdb0896 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:10.614256 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4ed7972d-95c6-4037-bb9e-e28eefdb0896 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:10.714497 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4ed7972d-95c6-4037-bb9e-e28eefdb0896 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:10.715693 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4ed7972d-95c6-4037-bb9e-e28eefdb0896 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:10.716220 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.objects.instance [None req-4ed7972d-95c6-4037-bb9e-e28eefdb0896 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lazy-loading 'fault' on Instance uuid 6c0ac4cf-7982-406b-a2f0-115ca5721a10 {{(pid=99512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 15 19:59:10.808927 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-4ed7972d-95c6-4037-bb9e-e28eefdb0896 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:10.821866 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-4ed7972d-95c6-4037-bb9e-e28eefdb0896 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:10.824162 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-4ed7972d-95c6-4037-bb9e-e28eefdb0896 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:10.825419 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-4ed7972d-95c6-4037-bb9e-e28eefdb0896 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 200 len: 1371 microversion: 2.20 time: 0.229013 Apr 15 19:59:10.826043 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 370/825] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:59:10 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 1371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:59:11.856398 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7a01aaf1-66f2-4d48-a610-63fec6b24ea3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:59:11.857318 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7a01aaf1-66f2-4d48-a610-63fec6b24ea3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:11.866142 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7a01aaf1-66f2-4d48-a610-63fec6b24ea3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:11.866465 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7a01aaf1-66f2-4d48-a610-63fec6b24ea3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:11.867330 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7a01aaf1-66f2-4d48-a610-63fec6b24ea3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:11.867832 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7a01aaf1-66f2-4d48-a610-63fec6b24ea3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:11.921146 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-7a01aaf1-66f2-4d48-a610-63fec6b24ea3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] HTTP exception thrown: Instance 6c0ac4cf-7982-406b-a2f0-115ca5721a10 could not be found. Apr 15 19:59:11.921816 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7a01aaf1-66f2-4d48-a610-63fec6b24ea3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Returning 404 to user: Instance 6c0ac4cf-7982-406b-a2f0-115ca5721a10 could not be found. {{(pid=99511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 19:59:11.922716 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7a01aaf1-66f2-4d48-a610-63fec6b24ea3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 404 len: 111 microversion: 2.20 time: 0.071323 Apr 15 19:59:11.923357 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 456/826] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:59:11 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 15 19:59:11.932376 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-04225b3f-9d85-4171-8379-dff38b36c74a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '.version_select at 0x7f18d8c397b8>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:59:11.954554 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-04225b3f-9d85-4171-8379-dff38b36c74a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1103302972" status: 204 len: 0 microversion: 2.20 time: 0.026086 Apr 15 19:59:11.955614 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 371/827] 10.222.0.58 () {60 vars in 1252 bytes} [Thu Apr 15 19:59:11 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1103302972 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 15 19:59:13.177063 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-3006dadd-ef2b-453e-b3e4-4feef52abfdd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'create', calling method: .version_select at 0x7f18d82a6a60>, body: {"keypair": {"name": "tempest-keypair-1394026836"}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:59:13.199907 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-3006dadd-ef2b-453e-b3e4-4feef52abfdd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Getting quotas for project b1e9c7381e93406886cc6f3577690f28. Resources: {'key_pairs'} {{(pid=99511) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 15 19:59:13.203997 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-3006dadd-ef2b-453e-b3e4-4feef52abfdd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Getting quotas for user d70e02f8a6aa46c19265378d00f98895 and project b1e9c7381e93406886cc6f3577690f28. Resources: {'key_pairs'} {{(pid=99511) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 15 19:59:13.427356 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-3006dadd-ef2b-453e-b3e4-4feef52abfdd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Getting quotas for project b1e9c7381e93406886cc6f3577690f28. Resources: {'key_pairs'} {{(pid=99511) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 15 19:59:13.431202 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-3006dadd-ef2b-453e-b3e4-4feef52abfdd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Getting quotas for user d70e02f8a6aa46c19265378d00f98895 and project b1e9c7381e93406886cc6f3577690f28. Resources: {'key_pairs'} {{(pid=99511) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 15 19:59:13.444580 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-3006dadd-ef2b-453e-b3e4-4feef52abfdd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.271774 Apr 15 19:59:13.445233 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 457/828] 10.222.0.58 () {62 vars in 1189 bytes} [Thu Apr 15 19:59:13 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 273 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Apr 15 19:59:15.620544 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6ac8e9e1-9f62-4a82-9664-a512de30174a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-461978377", "imageRef": "10d66d6e-f687-4228-93d1-67502c9b42e2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "985a7b11-3fa6-4a91-bf02-60ccff754b78"}], "security_groups": [{"name": "tempest-securitygroup--2019029753"}], "key_name": "tempest-keypair-1394026836", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:59:15.760943 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.network.neutron [None req-6ac8e9e1-9f62-4a82-9664-a512de30174a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] validate_networks() for [('985a7b11-3fa6-4a91-bf02-60ccff754b78', None, None, None)] {{(pid=99512) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 15 19:59:16.436767 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-6ac8e9e1-9f62-4a82-9664-a512de30174a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Flavor limits 0:0:0 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 15 19:59:16.437249 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-6ac8e9e1-9f62-4a82-9664-a512de30174a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Image limits 0:0:0 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 15 19:59:16.437795 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-6ac8e9e1-9f62-4a82-9664-a512de30174a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Flavor pref 0:0:0 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 15 19:59:16.438253 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-6ac8e9e1-9f62-4a82-9664-a512de30174a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Image pref 0:0:0 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 15 19:59:16.438718 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-6ac8e9e1-9f62-4a82-9664-a512de30174a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 15 19:59:16.447719 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6ac8e9e1-9f62-4a82-9664-a512de30174a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:16.448314 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6ac8e9e1-9f62-4a82-9664-a512de30174a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:16.449193 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6ac8e9e1-9f62-4a82-9664-a512de30174a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:16.449695 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6ac8e9e1-9f62-4a82-9664-a512de30174a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:16.468529 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-6ac8e9e1-9f62-4a82-9664-a512de30174a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Getting quotas for project b1e9c7381e93406886cc6f3577690f28. Resources: {'cores', 'instances', 'ram'} {{(pid=99512) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 15 19:59:16.472860 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-6ac8e9e1-9f62-4a82-9664-a512de30174a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Getting quotas for user d70e02f8a6aa46c19265378d00f98895 and project b1e9c7381e93406886cc6f3577690f28. Resources: {'cores', 'instances', 'ram'} {{(pid=99512) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 15 19:59:16.484671 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6ac8e9e1-9f62-4a82-9664-a512de30174a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Going to run 1 instances... {{(pid=99512) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 15 19:59:16.487244 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6ac8e9e1-9f62-4a82-9664-a512de30174a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='10d66d6e-f687-4228-93d1-67502c9b42e2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 15 19:59:16.540063 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6ac8e9e1-9f62-4a82-9664-a512de30174a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.924133 Apr 15 19:59:16.540770 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 372/829] 10.222.0.58 () {62 vars in 1178 bytes} [Thu Apr 15 19:59:15 2021] POST /compute/v2.1/servers => generated 402 bytes in 926 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Apr 15 19:59:16.551619 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-aee4e9ac-f4ac-45d0-a17d-e10f0bad7c09 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:59:16.552314 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-aee4e9ac-f4ac-45d0-a17d-e10f0bad7c09 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:16.633546 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-aee4e9ac-f4ac-45d0-a17d-e10f0bad7c09 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:16.643534 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-aee4e9ac-f4ac-45d0-a17d-e10f0bad7c09 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:16.645264 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-aee4e9ac-f4ac-45d0-a17d-e10f0bad7c09 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:16.647038 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-aee4e9ac-f4ac-45d0-a17d-e10f0bad7c09 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1281 microversion: 2.20 time: 0.099097 Apr 15 19:59:16.647719 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 458/830] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:59:16 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1281 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:59:17.667540 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6c44af2a-4b3b-4e50-88bc-76b16fc39e00 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:59:17.668213 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6c44af2a-4b3b-4e50-88bc-76b16fc39e00 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:17.676599 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6c44af2a-4b3b-4e50-88bc-76b16fc39e00 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:17.677105 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6c44af2a-4b3b-4e50-88bc-76b16fc39e00 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:17.678685 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6c44af2a-4b3b-4e50-88bc-76b16fc39e00 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:17.679190 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6c44af2a-4b3b-4e50-88bc-76b16fc39e00 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:17.824106 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-6c44af2a-4b3b-4e50-88bc-76b16fc39e00 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:17.833324 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-6c44af2a-4b3b-4e50-88bc-76b16fc39e00 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:17.836098 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-6c44af2a-4b3b-4e50-88bc-76b16fc39e00 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:17.836922 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6c44af2a-4b3b-4e50-88bc-76b16fc39e00 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1341 microversion: 2.20 time: 0.174191 Apr 15 19:59:17.837734 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 373/831] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:59:17 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1341 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:59:18.856473 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-bb2e0294-bf64-4902-802c-c0416fe17ad7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:59:18.857152 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-bb2e0294-bf64-4902-802c-c0416fe17ad7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:18.865867 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bb2e0294-bf64-4902-802c-c0416fe17ad7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:18.866456 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bb2e0294-bf64-4902-802c-c0416fe17ad7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:18.867213 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bb2e0294-bf64-4902-802c-c0416fe17ad7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:18.867717 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bb2e0294-bf64-4902-802c-c0416fe17ad7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:19.525121 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-bb2e0294-bf64-4902-802c-c0416fe17ad7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:19.534594 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-bb2e0294-bf64-4902-802c-c0416fe17ad7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:19.536345 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-bb2e0294-bf64-4902-802c-c0416fe17ad7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:19.537506 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-bb2e0294-bf64-4902-802c-c0416fe17ad7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1407 microversion: 2.20 time: 0.685315 Apr 15 19:59:19.538330 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 459/832] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:59:18 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1407 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:59:20.393132 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-ad97612a-e00c-45af-b4b4-561dff5b88ef req-cbd9dc6d-4d65-466f-affe-fb01e981408d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aac757a2-25b5-4006-abd0-4b3aa0b5ae08", "tag": "094b251a-1524-4ff8-b586-45456b2a7026"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:59:20.394919 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:59:20.394919 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:59:20.404882 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-ad97612a-e00c-45af-b4b4-561dff5b88ef req-cbd9dc6d-4d65-466f-affe-fb01e981408d service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:20.405385 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-ad97612a-e00c-45af-b4b4-561dff5b88ef req-cbd9dc6d-4d65-466f-affe-fb01e981408d service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:20.424007 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-ad97612a-e00c-45af-b4b4-561dff5b88ef req-cbd9dc6d-4d65-466f-affe-fb01e981408d service nova] Creating event network-changed:094b251a-1524-4ff8-b586-45456b2a7026 for instance aac757a2-25b5-4006-abd0-4b3aa0b5ae08 on hv-cinder-78638 Apr 15 19:59:20.429826 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-ad97612a-e00c-45af-b4b4-561dff5b88ef req-cbd9dc6d-4d65-466f-affe-fb01e981408d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040566 Apr 15 19:59:20.430630 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 374/833] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:59:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:59:20.557284 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-fa2039fd-8981-46b4-87d1-0d2828ed11c3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:59:20.557997 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-fa2039fd-8981-46b4-87d1-0d2828ed11c3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:20.565910 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fa2039fd-8981-46b4-87d1-0d2828ed11c3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:20.566426 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fa2039fd-8981-46b4-87d1-0d2828ed11c3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:20.567302 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fa2039fd-8981-46b4-87d1-0d2828ed11c3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:20.567809 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fa2039fd-8981-46b4-87d1-0d2828ed11c3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:20.858772 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-fa2039fd-8981-46b4-87d1-0d2828ed11c3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:20.868950 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-fa2039fd-8981-46b4-87d1-0d2828ed11c3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:20.870644 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-fa2039fd-8981-46b4-87d1-0d2828ed11c3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:20.871888 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-fa2039fd-8981-46b4-87d1-0d2828ed11c3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1407 microversion: 2.20 time: 0.319305 Apr 15 19:59:20.872505 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 460/834] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:59:20 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1407 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:59:21.891920 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-30f3ec27-7ff8-4e7b-ad3b-d6e4f159515d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:59:21.892657 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-30f3ec27-7ff8-4e7b-ad3b-d6e4f159515d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:21.900761 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-30f3ec27-7ff8-4e7b-ad3b-d6e4f159515d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:21.901278 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-30f3ec27-7ff8-4e7b-ad3b-d6e4f159515d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:21.902116 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-30f3ec27-7ff8-4e7b-ad3b-d6e4f159515d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:21.902609 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-30f3ec27-7ff8-4e7b-ad3b-d6e4f159515d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:22.119617 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-30f3ec27-7ff8-4e7b-ad3b-d6e4f159515d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:22.128909 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-30f3ec27-7ff8-4e7b-ad3b-d6e4f159515d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:22.130662 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-30f3ec27-7ff8-4e7b-ad3b-d6e4f159515d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:22.131843 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-30f3ec27-7ff8-4e7b-ad3b-d6e4f159515d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1407 microversion: 2.20 time: 0.244782 Apr 15 19:59:22.132457 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 375/835] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:59:21 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:59:23.151084 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-581f9c94-e5ef-44e3-b3bc-a610ce96e211 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:59:23.151822 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-581f9c94-e5ef-44e3-b3bc-a610ce96e211 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:23.159625 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-581f9c94-e5ef-44e3-b3bc-a610ce96e211 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:23.160147 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-581f9c94-e5ef-44e3-b3bc-a610ce96e211 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:23.160971 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-581f9c94-e5ef-44e3-b3bc-a610ce96e211 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:23.161436 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-581f9c94-e5ef-44e3-b3bc-a610ce96e211 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:23.376769 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-581f9c94-e5ef-44e3-b3bc-a610ce96e211 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:23.386935 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-581f9c94-e5ef-44e3-b3bc-a610ce96e211 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:23.388645 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-581f9c94-e5ef-44e3-b3bc-a610ce96e211 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:23.389810 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-581f9c94-e5ef-44e3-b3bc-a610ce96e211 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1407 microversion: 2.20 time: 0.243651 Apr 15 19:59:23.390410 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 461/836] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:59:23 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:59:24.410152 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-baabb35c-1601-4d25-b59a-8272937e1252 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:59:24.410863 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-baabb35c-1601-4d25-b59a-8272937e1252 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:24.419540 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-baabb35c-1601-4d25-b59a-8272937e1252 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:24.420049 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-baabb35c-1601-4d25-b59a-8272937e1252 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:24.420879 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-baabb35c-1601-4d25-b59a-8272937e1252 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:24.421369 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-baabb35c-1601-4d25-b59a-8272937e1252 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:24.627820 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-baabb35c-1601-4d25-b59a-8272937e1252 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:24.637524 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-baabb35c-1601-4d25-b59a-8272937e1252 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:24.639209 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-baabb35c-1601-4d25-b59a-8272937e1252 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:24.640406 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-baabb35c-1601-4d25-b59a-8272937e1252 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1407 microversion: 2.20 time: 0.234438 Apr 15 19:59:24.641016 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 376/837] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:59:24 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:59:25.092784 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-d7345094-8b85-44ae-ab45-676149079979 req-fbb49eec-2025-4517-881b-ffb50ed9bbdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aac757a2-25b5-4006-abd0-4b3aa0b5ae08", "name": "network-vif-plugged", "status": "completed", "tag": "094b251a-1524-4ff8-b586-45456b2a7026"}]} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:59:25.094705 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:59:25.094705 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:59:25.103724 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-d7345094-8b85-44ae-ab45-676149079979 req-fbb49eec-2025-4517-881b-ffb50ed9bbdb service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:25.104197 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-d7345094-8b85-44ae-ab45-676149079979 req-fbb49eec-2025-4517-881b-ffb50ed9bbdb service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:25.123957 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-d7345094-8b85-44ae-ab45-676149079979 req-fbb49eec-2025-4517-881b-ffb50ed9bbdb service nova] Creating event network-vif-plugged:094b251a-1524-4ff8-b586-45456b2a7026 for instance aac757a2-25b5-4006-abd0-4b3aa0b5ae08 on hv-cinder-78638 Apr 15 19:59:25.129092 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-d7345094-8b85-44ae-ab45-676149079979 req-fbb49eec-2025-4517-881b-ffb50ed9bbdb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040208 Apr 15 19:59:25.129719 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 462/838] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:59:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 19:59:25.660274 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-3f5bea5a-2e47-4bf2-9ef2-d4df62493d5e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:59:25.660875 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-3f5bea5a-2e47-4bf2-9ef2-d4df62493d5e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:25.668990 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3f5bea5a-2e47-4bf2-9ef2-d4df62493d5e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:25.669494 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3f5bea5a-2e47-4bf2-9ef2-d4df62493d5e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:25.670321 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3f5bea5a-2e47-4bf2-9ef2-d4df62493d5e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:25.670811 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3f5bea5a-2e47-4bf2-9ef2-d4df62493d5e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:25.879659 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3f5bea5a-2e47-4bf2-9ef2-d4df62493d5e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:25.889141 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3f5bea5a-2e47-4bf2-9ef2-d4df62493d5e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:25.890801 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3f5bea5a-2e47-4bf2-9ef2-d4df62493d5e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:25.892014 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-3f5bea5a-2e47-4bf2-9ef2-d4df62493d5e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1407 microversion: 2.20 time: 0.235846 Apr 15 19:59:25.892645 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 377/839] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:59:25 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:59:26.911729 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-0aa972c3-21e6-4ddd-8ed3-1103cde3d329 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:59:26.912492 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-0aa972c3-21e6-4ddd-8ed3-1103cde3d329 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:26.920902 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0aa972c3-21e6-4ddd-8ed3-1103cde3d329 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:26.921405 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0aa972c3-21e6-4ddd-8ed3-1103cde3d329 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:26.922229 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0aa972c3-21e6-4ddd-8ed3-1103cde3d329 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:26.922718 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0aa972c3-21e6-4ddd-8ed3-1103cde3d329 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:27.135007 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-0aa972c3-21e6-4ddd-8ed3-1103cde3d329 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:27.144401 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-0aa972c3-21e6-4ddd-8ed3-1103cde3d329 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:27.146044 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-0aa972c3-21e6-4ddd-8ed3-1103cde3d329 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 19:59:27.147246 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-0aa972c3-21e6-4ddd-8ed3-1103cde3d329 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1599 microversion: 2.20 time: 0.240192 Apr 15 19:59:27.147870 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 463/840] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 19:59:26 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1599 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:59:27.165942 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9e35c87a-8da7-44a1-81a2-66cdff6bf56b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 19:59:27.166486 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9e35c87a-8da7-44a1-81a2-66cdff6bf56b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:27.174445 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9e35c87a-8da7-44a1-81a2-66cdff6bf56b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:27.174956 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9e35c87a-8da7-44a1-81a2-66cdff6bf56b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:27.175866 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9e35c87a-8da7-44a1-81a2-66cdff6bf56b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:27.176366 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9e35c87a-8da7-44a1-81a2-66cdff6bf56b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:27.333307 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9e35c87a-8da7-44a1-81a2-66cdff6bf56b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.171746 Apr 15 19:59:27.334020 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 378/841] 10.222.0.58 () {60 vars in 1306 bytes} [Thu Apr 15 19:59:27 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/os-interface => generated 284 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 19:59:29.063638 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-2a4263fd-00e2-42f7-977d-d2216858ada9 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:59:29.065105 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-2a4263fd-00e2-42f7-977d-d2216858ada9 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:29.065379 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-e79f105a-2ba2-4539-b3b3-5f82e716ec3d req-4039c827-664f-4271-9e69-45c4e87edaf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aac757a2-25b5-4006-abd0-4b3aa0b5ae08", "tag": "094b251a-1524-4ff8-b586-45456b2a7026"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:59:29.067034 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 19:59:29.067034 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 19:59:29.073715 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2a4263fd-00e2-42f7-977d-d2216858ada9 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:29.074479 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2a4263fd-00e2-42f7-977d-d2216858ada9 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:29.075462 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2a4263fd-00e2-42f7-977d-d2216858ada9 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:29.076031 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2a4263fd-00e2-42f7-977d-d2216858ada9 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:29.076315 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-e79f105a-2ba2-4539-b3b3-5f82e716ec3d req-4039c827-664f-4271-9e69-45c4e87edaf0 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:29.076812 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-e79f105a-2ba2-4539-b3b3-5f82e716ec3d req-4039c827-664f-4271-9e69-45c4e87edaf0 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:29.097635 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-e79f105a-2ba2-4539-b3b3-5f82e716ec3d req-4039c827-664f-4271-9e69-45c4e87edaf0 service nova] Creating event network-changed:094b251a-1524-4ff8-b586-45456b2a7026 for instance aac757a2-25b5-4006-abd0-4b3aa0b5ae08 on hv-cinder-78638 Apr 15 19:59:29.103390 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-e79f105a-2ba2-4539-b3b3-5f82e716ec3d req-4039c827-664f-4271-9e69-45c4e87edaf0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041797 Apr 15 19:59:29.104223 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 379/842] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 19:59:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 15 19:59:29.183170 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-2a4263fd-00e2-42f7-977d-d2216858ada9 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 14 microversion: 2.20 time: 0.123743 Apr 15 19:59:29.186953 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 464/843] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:59:29 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:59:30.196128 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-aaf097b6-5ffc-40dc-bc76-d830711efe20 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:59:30.197337 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-aaf097b6-5ffc-40dc-bc76-d830711efe20 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:30.205528 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-aaf097b6-5ffc-40dc-bc76-d830711efe20 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:30.206033 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-aaf097b6-5ffc-40dc-bc76-d830711efe20 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:30.206873 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-aaf097b6-5ffc-40dc-bc76-d830711efe20 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:30.207385 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-aaf097b6-5ffc-40dc-bc76-d830711efe20 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:30.303396 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-aaf097b6-5ffc-40dc-bc76-d830711efe20 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 14 microversion: 2.20 time: 0.111865 Apr 15 19:59:30.304082 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 380/844] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:59:30 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:59:31.315794 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6f19b2c8-e6e3-43ec-9227-8d66f796a336 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:59:31.316944 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6f19b2c8-e6e3-43ec-9227-8d66f796a336 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:31.325535 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6f19b2c8-e6e3-43ec-9227-8d66f796a336 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:31.326044 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6f19b2c8-e6e3-43ec-9227-8d66f796a336 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:31.326917 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6f19b2c8-e6e3-43ec-9227-8d66f796a336 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:31.327457 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6f19b2c8-e6e3-43ec-9227-8d66f796a336 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:31.422604 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6f19b2c8-e6e3-43ec-9227-8d66f796a336 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 14 microversion: 2.20 time: 0.111253 Apr 15 19:59:31.423303 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 465/845] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:59:31 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:59:32.435440 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7fe99480-f421-4cf3-953e-436244afcda6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:59:32.436594 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7fe99480-f421-4cf3-953e-436244afcda6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:32.445891 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7fe99480-f421-4cf3-953e-436244afcda6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:32.446409 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7fe99480-f421-4cf3-953e-436244afcda6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:32.447248 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7fe99480-f421-4cf3-953e-436244afcda6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:32.447777 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7fe99480-f421-4cf3-953e-436244afcda6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:32.544177 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7fe99480-f421-4cf3-953e-436244afcda6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 14 microversion: 2.20 time: 0.113269 Apr 15 19:59:32.544833 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 381/846] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:59:32 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:59:33.556650 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c6526a00-8c21-45a8-bd34-cee46d3c0e76 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:59:33.557832 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c6526a00-8c21-45a8-bd34-cee46d3c0e76 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:33.566429 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c6526a00-8c21-45a8-bd34-cee46d3c0e76 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:33.566931 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c6526a00-8c21-45a8-bd34-cee46d3c0e76 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:33.568266 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c6526a00-8c21-45a8-bd34-cee46d3c0e76 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:33.568754 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c6526a00-8c21-45a8-bd34-cee46d3c0e76 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:33.666204 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c6526a00-8c21-45a8-bd34-cee46d3c0e76 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 14 microversion: 2.20 time: 0.114041 Apr 15 19:59:33.666877 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 466/847] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:59:33 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:59:34.678562 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-50ef5b2e-277c-42f1-b1f0-85a8dadbfdaa tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:59:34.679744 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-50ef5b2e-277c-42f1-b1f0-85a8dadbfdaa tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:34.688400 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-50ef5b2e-277c-42f1-b1f0-85a8dadbfdaa tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:34.688917 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-50ef5b2e-277c-42f1-b1f0-85a8dadbfdaa tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:34.689763 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-50ef5b2e-277c-42f1-b1f0-85a8dadbfdaa tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:34.690266 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-50ef5b2e-277c-42f1-b1f0-85a8dadbfdaa tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:34.789128 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-50ef5b2e-277c-42f1-b1f0-85a8dadbfdaa tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 14 microversion: 2.20 time: 0.114653 Apr 15 19:59:34.789830 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 382/848] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:59:34 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:59:35.801151 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-1f01e169-cb86-4ed5-880c-c039f231b352 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:59:35.802939 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-1f01e169-cb86-4ed5-880c-c039f231b352 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:35.811891 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1f01e169-cb86-4ed5-880c-c039f231b352 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:35.812397 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1f01e169-cb86-4ed5-880c-c039f231b352 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:35.813216 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1f01e169-cb86-4ed5-880c-c039f231b352 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:35.813703 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1f01e169-cb86-4ed5-880c-c039f231b352 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:35.916432 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-1f01e169-cb86-4ed5-880c-c039f231b352 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 14 microversion: 2.20 time: 0.119772 Apr 15 19:59:35.917104 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 467/849] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:59:35 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:59:36.929596 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-1530a6a6-e248-4773-8d04-2854cf198afc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:59:36.930785 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-1530a6a6-e248-4773-8d04-2854cf198afc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:36.939422 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1530a6a6-e248-4773-8d04-2854cf198afc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:36.939935 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1530a6a6-e248-4773-8d04-2854cf198afc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:36.940776 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1530a6a6-e248-4773-8d04-2854cf198afc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:36.941271 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1530a6a6-e248-4773-8d04-2854cf198afc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:37.046048 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-1530a6a6-e248-4773-8d04-2854cf198afc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 14 microversion: 2.20 time: 0.121583 Apr 15 19:59:37.046703 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 383/850] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:59:36 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:59:38.059009 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-3adf4c2b-22ea-42ca-ae46-2641d0dd1b54 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:59:38.060183 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-3adf4c2b-22ea-42ca-ae46-2641d0dd1b54 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:38.068807 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3adf4c2b-22ea-42ca-ae46-2641d0dd1b54 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:38.069324 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3adf4c2b-22ea-42ca-ae46-2641d0dd1b54 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:38.070165 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3adf4c2b-22ea-42ca-ae46-2641d0dd1b54 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:38.070666 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3adf4c2b-22ea-42ca-ae46-2641d0dd1b54 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:38.172342 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-3adf4c2b-22ea-42ca-ae46-2641d0dd1b54 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 14 microversion: 2.20 time: 0.117721 Apr 15 19:59:38.173030 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 468/851] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:59:38 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 19:59:39.185465 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-de5adc39-d044-4fa6-b86d-c4b1d7c546ef tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:59:39.186607 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-de5adc39-d044-4fa6-b86d-c4b1d7c546ef tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:39.196046 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-de5adc39-d044-4fa6-b86d-c4b1d7c546ef tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:39.196554 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-de5adc39-d044-4fa6-b86d-c4b1d7c546ef tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:39.197389 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-de5adc39-d044-4fa6-b86d-c4b1d7c546ef tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:39.197885 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-de5adc39-d044-4fa6-b86d-c4b1d7c546ef tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:39.295413 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-de5adc39-d044-4fa6-b86d-c4b1d7c546ef tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 6882 microversion: 2.20 time: 0.114512 Apr 15 19:59:39.296293 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 384/852] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:59:39 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 6882 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 19:59:40.307197 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7051033a-8fd7-4908-ad3c-9de223868927 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:59:40.308354 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7051033a-8fd7-4908-ad3c-9de223868927 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:40.316869 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7051033a-8fd7-4908-ad3c-9de223868927 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:40.317417 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7051033a-8fd7-4908-ad3c-9de223868927 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:40.318734 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7051033a-8fd7-4908-ad3c-9de223868927 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:40.319220 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7051033a-8fd7-4908-ad3c-9de223868927 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:40.416216 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7051033a-8fd7-4908-ad3c-9de223868927 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 15025 microversion: 2.20 time: 0.113433 Apr 15 19:59:40.416879 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 469/853] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:59:40 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 15025 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:59:41.428413 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-8161002a-e580-4e71-a930-3accf1c5e4b7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:59:41.429546 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-8161002a-e580-4e71-a930-3accf1c5e4b7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:41.438172 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8161002a-e580-4e71-a930-3accf1c5e4b7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:41.438679 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8161002a-e580-4e71-a930-3accf1c5e4b7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:41.439537 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8161002a-e580-4e71-a930-3accf1c5e4b7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:41.440046 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8161002a-e580-4e71-a930-3accf1c5e4b7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:41.541303 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-8161002a-e580-4e71-a930-3accf1c5e4b7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 18561 microversion: 2.20 time: 0.117372 Apr 15 19:59:41.541959 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 385/854] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:59:41 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 18561 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:59:42.554203 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c4229161-3dc5-4f5e-adec-9572ca8e49e1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:59:42.555361 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c4229161-3dc5-4f5e-adec-9572ca8e49e1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:42.564022 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c4229161-3dc5-4f5e-adec-9572ca8e49e1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:42.564526 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c4229161-3dc5-4f5e-adec-9572ca8e49e1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:42.565350 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c4229161-3dc5-4f5e-adec-9572ca8e49e1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:42.565839 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c4229161-3dc5-4f5e-adec-9572ca8e49e1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:42.662353 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c4229161-3dc5-4f5e-adec-9572ca8e49e1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 20193 microversion: 2.20 time: 0.112443 Apr 15 19:59:42.663644 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 470/855] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:59:42 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 20193 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:59:43.675439 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-53286bd2-2972-46fb-9f43-bb7cc30b4fe2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:59:43.676572 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-53286bd2-2972-46fb-9f43-bb7cc30b4fe2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:43.685659 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-53286bd2-2972-46fb-9f43-bb7cc30b4fe2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:43.686161 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-53286bd2-2972-46fb-9f43-bb7cc30b4fe2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:43.686982 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-53286bd2-2972-46fb-9f43-bb7cc30b4fe2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:43.687499 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-53286bd2-2972-46fb-9f43-bb7cc30b4fe2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:43.790538 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-53286bd2-2972-46fb-9f43-bb7cc30b4fe2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 22826 microversion: 2.20 time: 0.119493 Apr 15 19:59:43.791216 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 386/856] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:59:43 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 22826 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:59:44.803304 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-198b9a47-49aa-4953-a789-015b3e828013 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:59:44.804452 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-198b9a47-49aa-4953-a789-015b3e828013 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:44.813630 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-198b9a47-49aa-4953-a789-015b3e828013 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:44.814178 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-198b9a47-49aa-4953-a789-015b3e828013 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:44.815001 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-198b9a47-49aa-4953-a789-015b3e828013 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:44.815549 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-198b9a47-49aa-4953-a789-015b3e828013 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:44.911164 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-198b9a47-49aa-4953-a789-015b3e828013 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 23886 microversion: 2.20 time: 0.112355 Apr 15 19:59:44.911943 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 471/857] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:59:44 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 23886 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:59:45.925046 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f75f39b6-edd0-4467-b0c4-f0bd88e58eaa tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:59:45.926173 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f75f39b6-edd0-4467-b0c4-f0bd88e58eaa tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:45.935224 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f75f39b6-edd0-4467-b0c4-f0bd88e58eaa tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:45.935774 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f75f39b6-edd0-4467-b0c4-f0bd88e58eaa tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:45.936595 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f75f39b6-edd0-4467-b0c4-f0bd88e58eaa tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:45.937082 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f75f39b6-edd0-4467-b0c4-f0bd88e58eaa tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:46.034743 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f75f39b6-edd0-4467-b0c4-f0bd88e58eaa tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 25740 microversion: 2.20 time: 0.114088 Apr 15 19:59:46.035484 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 387/858] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:59:45 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 25740 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:59:47.048458 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ad8520c4-b9c8-40d7-8964-749e52c112bd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:59:47.049592 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ad8520c4-b9c8-40d7-8964-749e52c112bd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:47.058585 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ad8520c4-b9c8-40d7-8964-749e52c112bd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:47.059090 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ad8520c4-b9c8-40d7-8964-749e52c112bd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:47.059939 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ad8520c4-b9c8-40d7-8964-749e52c112bd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:47.060425 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ad8520c4-b9c8-40d7-8964-749e52c112bd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:47.164820 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ad8520c4-b9c8-40d7-8964-749e52c112bd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 27016 microversion: 2.20 time: 0.120856 Apr 15 19:59:47.165520 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 472/859] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:59:47 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 27016 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:59:48.177990 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-0cfdadd5-00eb-4a0c-8151-c8cb43ad4bc7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:59:48.179180 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-0cfdadd5-00eb-4a0c-8151-c8cb43ad4bc7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:48.187817 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0cfdadd5-00eb-4a0c-8151-c8cb43ad4bc7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:48.188329 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0cfdadd5-00eb-4a0c-8151-c8cb43ad4bc7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:48.189168 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0cfdadd5-00eb-4a0c-8151-c8cb43ad4bc7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:48.189665 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0cfdadd5-00eb-4a0c-8151-c8cb43ad4bc7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:48.293668 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-0cfdadd5-00eb-4a0c-8151-c8cb43ad4bc7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 27711 microversion: 2.20 time: 0.120108 Apr 15 19:59:48.294580 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 388/860] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:59:48 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 27711 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:59:49.307248 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-03062a9c-0fd8-40ca-88cf-3926b67b54dc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:59:49.308418 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-03062a9c-0fd8-40ca-88cf-3926b67b54dc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:49.317057 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-03062a9c-0fd8-40ca-88cf-3926b67b54dc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:49.317568 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-03062a9c-0fd8-40ca-88cf-3926b67b54dc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:49.318404 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-03062a9c-0fd8-40ca-88cf-3926b67b54dc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:49.318900 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-03062a9c-0fd8-40ca-88cf-3926b67b54dc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:49.424544 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-03062a9c-0fd8-40ca-88cf-3926b67b54dc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28200 microversion: 2.20 time: 0.122212 Apr 15 19:59:49.425319 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 473/861] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:59:49 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28200 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:59:50.438281 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b2f10431-fe5e-43f2-9c34-c9e5d9cdde43 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:59:50.439476 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b2f10431-fe5e-43f2-9c34-c9e5d9cdde43 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:50.447970 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b2f10431-fe5e-43f2-9c34-c9e5d9cdde43 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:50.448476 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b2f10431-fe5e-43f2-9c34-c9e5d9cdde43 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:50.449307 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b2f10431-fe5e-43f2-9c34-c9e5d9cdde43 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:50.449793 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b2f10431-fe5e-43f2-9c34-c9e5d9cdde43 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:50.549395 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b2f10431-fe5e-43f2-9c34-c9e5d9cdde43 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28200 microversion: 2.20 time: 0.115503 Apr 15 19:59:50.550120 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 389/862] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:59:50 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28200 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:59:51.562435 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-51fc6065-e8a7-46c8-a729-60268a2e16ba tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:59:51.564018 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-51fc6065-e8a7-46c8-a729-60268a2e16ba tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:51.572537 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-51fc6065-e8a7-46c8-a729-60268a2e16ba tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:51.573038 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-51fc6065-e8a7-46c8-a729-60268a2e16ba tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:51.573871 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-51fc6065-e8a7-46c8-a729-60268a2e16ba tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:51.574367 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-51fc6065-e8a7-46c8-a729-60268a2e16ba tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:51.676423 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-51fc6065-e8a7-46c8-a729-60268a2e16ba tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28200 microversion: 2.20 time: 0.118357 Apr 15 19:59:51.677348 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 474/863] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:59:51 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28200 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:59:52.690184 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-8f8d0760-262f-43c4-8284-7b26fd6631e0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:59:52.691363 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-8f8d0760-262f-43c4-8284-7b26fd6631e0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:52.700431 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8f8d0760-262f-43c4-8284-7b26fd6631e0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:52.700952 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8f8d0760-262f-43c4-8284-7b26fd6631e0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:52.701794 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8f8d0760-262f-43c4-8284-7b26fd6631e0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:52.702295 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8f8d0760-262f-43c4-8284-7b26fd6631e0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:52.798900 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-8f8d0760-262f-43c4-8284-7b26fd6631e0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28200 microversion: 2.20 time: 0.113197 Apr 15 19:59:52.799872 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 390/864] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:59:52 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28200 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:59:53.811781 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-1a134ab0-fdc5-491e-b108-ed15e663e617 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:59:53.812923 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-1a134ab0-fdc5-491e-b108-ed15e663e617 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:53.821648 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1a134ab0-fdc5-491e-b108-ed15e663e617 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:53.822151 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1a134ab0-fdc5-491e-b108-ed15e663e617 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:53.822975 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1a134ab0-fdc5-491e-b108-ed15e663e617 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:53.823511 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1a134ab0-fdc5-491e-b108-ed15e663e617 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:53.923937 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-1a134ab0-fdc5-491e-b108-ed15e663e617 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28200 microversion: 2.20 time: 0.116509 Apr 15 19:59:53.924882 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 475/865] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:59:53 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28200 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:59:54.937500 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e8a9075d-5d22-4ad7-8786-73bf99da83ee tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:59:54.938685 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e8a9075d-5d22-4ad7-8786-73bf99da83ee tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:54.947227 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e8a9075d-5d22-4ad7-8786-73bf99da83ee tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:54.947768 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e8a9075d-5d22-4ad7-8786-73bf99da83ee tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:54.948600 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e8a9075d-5d22-4ad7-8786-73bf99da83ee tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:54.949099 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e8a9075d-5d22-4ad7-8786-73bf99da83ee tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:55.050026 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e8a9075d-5d22-4ad7-8786-73bf99da83ee tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28200 microversion: 2.20 time: 0.117505 Apr 15 19:59:55.050692 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 391/866] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:59:54 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28200 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:59:56.063559 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d02cef74-6dd4-473f-adc8-4a43f3f6680f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:59:56.064716 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d02cef74-6dd4-473f-adc8-4a43f3f6680f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:56.074004 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d02cef74-6dd4-473f-adc8-4a43f3f6680f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:56.074510 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d02cef74-6dd4-473f-adc8-4a43f3f6680f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:56.075386 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d02cef74-6dd4-473f-adc8-4a43f3f6680f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:56.075882 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d02cef74-6dd4-473f-adc8-4a43f3f6680f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:56.172807 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d02cef74-6dd4-473f-adc8-4a43f3f6680f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28200 microversion: 2.20 time: 0.113740 Apr 15 19:59:56.173482 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 476/867] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:59:56 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28200 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:59:57.186042 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-710050a1-1f88-4bb4-9d0f-b5fc9171de6c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:59:57.187232 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-710050a1-1f88-4bb4-9d0f-b5fc9171de6c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:57.195838 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-710050a1-1f88-4bb4-9d0f-b5fc9171de6c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:57.196313 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-710050a1-1f88-4bb4-9d0f-b5fc9171de6c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:57.197165 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-710050a1-1f88-4bb4-9d0f-b5fc9171de6c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:57.197646 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-710050a1-1f88-4bb4-9d0f-b5fc9171de6c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:57.298421 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-710050a1-1f88-4bb4-9d0f-b5fc9171de6c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28200 microversion: 2.20 time: 0.116871 Apr 15 19:59:57.299118 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 392/868] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:59:57 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28200 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:59:58.311887 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-96961781-1054-4f80-805c-7910f2655d5f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:59:58.313029 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-96961781-1054-4f80-805c-7910f2655d5f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:58.321535 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-96961781-1054-4f80-805c-7910f2655d5f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:58.322032 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-96961781-1054-4f80-805c-7910f2655d5f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:58.322855 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-96961781-1054-4f80-805c-7910f2655d5f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:58.323955 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-96961781-1054-4f80-805c-7910f2655d5f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:58.420512 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-96961781-1054-4f80-805c-7910f2655d5f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28200 microversion: 2.20 time: 0.113489 Apr 15 19:59:58.421208 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 477/869] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:59:58 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28200 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 19:59:59.433595 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-61a89487-a26b-470f-91ca-818a482e955b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 19:59:59.434802 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-61a89487-a26b-470f-91ca-818a482e955b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 19:59:59.443332 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-61a89487-a26b-470f-91ca-818a482e955b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:59.443847 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-61a89487-a26b-470f-91ca-818a482e955b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:59.444817 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-61a89487-a26b-470f-91ca-818a482e955b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 19:59:59.445309 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-61a89487-a26b-470f-91ca-818a482e955b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 19:59:59.549003 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-61a89487-a26b-470f-91ca-818a482e955b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28200 microversion: 2.20 time: 0.119795 Apr 15 19:59:59.549935 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 393/870] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 19:59:59 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28200 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:00:00.562358 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-1cbca0f5-7975-4106-8be7-f412cf541f9e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:00.563544 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-1cbca0f5-7975-4106-8be7-f412cf541f9e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:00.572225 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1cbca0f5-7975-4106-8be7-f412cf541f9e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:00.572741 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1cbca0f5-7975-4106-8be7-f412cf541f9e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:00.573580 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1cbca0f5-7975-4106-8be7-f412cf541f9e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:00.574078 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1cbca0f5-7975-4106-8be7-f412cf541f9e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:00.676142 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-1cbca0f5-7975-4106-8be7-f412cf541f9e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28200 microversion: 2.20 time: 0.118322 Apr 15 20:00:00.680332 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 478/871] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:00 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28200 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 15 20:00:01.690097 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-91585a21-2d20-4b9b-9c2e-acb1235dddff tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:01.691299 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-91585a21-2d20-4b9b-9c2e-acb1235dddff tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:01.699957 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-91585a21-2d20-4b9b-9c2e-acb1235dddff tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:01.700476 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-91585a21-2d20-4b9b-9c2e-acb1235dddff tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:01.701319 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-91585a21-2d20-4b9b-9c2e-acb1235dddff tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:01.701828 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-91585a21-2d20-4b9b-9c2e-acb1235dddff tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:01.802705 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-91585a21-2d20-4b9b-9c2e-acb1235dddff tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28200 microversion: 2.20 time: 0.117095 Apr 15 20:00:01.803405 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 394/872] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:01 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28200 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:00:02.815910 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-0dd87c5c-6c22-43dd-b4df-e11f455e20a4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:02.817045 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-0dd87c5c-6c22-43dd-b4df-e11f455e20a4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:02.826256 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0dd87c5c-6c22-43dd-b4df-e11f455e20a4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:02.826756 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0dd87c5c-6c22-43dd-b4df-e11f455e20a4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:02.827608 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0dd87c5c-6c22-43dd-b4df-e11f455e20a4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:02.828101 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0dd87c5c-6c22-43dd-b4df-e11f455e20a4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:02.927555 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-0dd87c5c-6c22-43dd-b4df-e11f455e20a4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28200 microversion: 2.20 time: 0.116174 Apr 15 20:00:02.928225 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 479/873] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:02 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28200 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:00:03.940710 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ea669f9f-942d-4cf9-9add-4d5c6458da25 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:03.941975 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ea669f9f-942d-4cf9-9add-4d5c6458da25 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:03.950694 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ea669f9f-942d-4cf9-9add-4d5c6458da25 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:03.951323 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ea669f9f-942d-4cf9-9add-4d5c6458da25 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:03.952128 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ea669f9f-942d-4cf9-9add-4d5c6458da25 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:03.952618 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ea669f9f-942d-4cf9-9add-4d5c6458da25 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:04.055647 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ea669f9f-942d-4cf9-9add-4d5c6458da25 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28200 microversion: 2.20 time: 0.118995 Apr 15 20:00:04.057228 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 395/874] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:03 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28200 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:00:05.069396 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-eac2de1d-3d8f-4592-9e3d-f51dd5fd1599 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:05.070504 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-eac2de1d-3d8f-4592-9e3d-f51dd5fd1599 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:05.079834 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-eac2de1d-3d8f-4592-9e3d-f51dd5fd1599 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:05.080350 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-eac2de1d-3d8f-4592-9e3d-f51dd5fd1599 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:05.081810 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-eac2de1d-3d8f-4592-9e3d-f51dd5fd1599 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:05.082318 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-eac2de1d-3d8f-4592-9e3d-f51dd5fd1599 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:05.179631 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-eac2de1d-3d8f-4592-9e3d-f51dd5fd1599 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28491 microversion: 2.20 time: 0.114655 Apr 15 20:00:05.180323 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 480/875] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:05 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28491 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:00:06.193347 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-1ae8607a-1c5f-4894-b3c5-a26b4b61d792 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:06.194486 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-1ae8607a-1c5f-4894-b3c5-a26b4b61d792 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:06.203082 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1ae8607a-1c5f-4894-b3c5-a26b4b61d792 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:06.203645 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1ae8607a-1c5f-4894-b3c5-a26b4b61d792 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:06.204486 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1ae8607a-1c5f-4894-b3c5-a26b4b61d792 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:06.204985 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1ae8607a-1c5f-4894-b3c5-a26b4b61d792 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:06.301896 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-1ae8607a-1c5f-4894-b3c5-a26b4b61d792 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28659 microversion: 2.20 time: 0.112876 Apr 15 20:00:06.302581 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 396/876] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:06 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28659 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:00:07.315544 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-0c1cc668-2cac-4942-903c-7fae8f90652d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:07.316680 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-0c1cc668-2cac-4942-903c-7fae8f90652d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:07.325857 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0c1cc668-2cac-4942-903c-7fae8f90652d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:07.326358 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0c1cc668-2cac-4942-903c-7fae8f90652d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:07.327181 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0c1cc668-2cac-4942-903c-7fae8f90652d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:07.327691 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0c1cc668-2cac-4942-903c-7fae8f90652d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:07.441933 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-0c1cc668-2cac-4942-903c-7fae8f90652d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28659 microversion: 2.20 time: 0.130905 Apr 15 20:00:07.442594 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 481/877] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:07 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28659 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:00:07.758947 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-fb916673-ced1-412d-bab1-47d627a0fd1e tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:07.759634 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-fb916673-ced1-412d-bab1-47d627a0fd1e tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:07.768354 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fb916673-ced1-412d-bab1-47d627a0fd1e tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:07.768866 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fb916673-ced1-412d-bab1-47d627a0fd1e tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:07.769709 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fb916673-ced1-412d-bab1-47d627a0fd1e tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:07.770208 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fb916673-ced1-412d-bab1-47d627a0fd1e tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:07.838838 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-fb916673-ced1-412d-bab1-47d627a0fd1e tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Going to try to terminate instance {{(pid=99512) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 15 20:00:08.091895 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-fb916673-ced1-412d-bab1-47d627a0fd1e tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "DELETE /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 204 len: 0 microversion: 2.1 time: 0.336825 Apr 15 20:00:08.092456 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 397/878] 10.222.0.58 () {58 vars in 1229 bytes} [Thu Apr 15 20:00:07 2021] DELETE /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 15 20:00:08.101877 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-1bae058a-d96b-4ab9-9a5c-764eca27feff tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:08.102647 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-1bae058a-d96b-4ab9-9a5c-764eca27feff tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:08.111839 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1bae058a-d96b-4ab9-9a5c-764eca27feff tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:08.112359 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1bae058a-d96b-4ab9-9a5c-764eca27feff tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:08.113196 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1bae058a-d96b-4ab9-9a5c-764eca27feff tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:08.113690 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1bae058a-d96b-4ab9-9a5c-764eca27feff tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:08.327304 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-1bae058a-d96b-4ab9-9a5c-764eca27feff tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:08.336161 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-1bae058a-d96b-4ab9-9a5c-764eca27feff tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1671 microversion: 2.1 time: 0.238811 Apr 15 20:00:08.336782 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 482/879] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:00:08 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1671 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:00:08.455808 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-99ed6b4e-18bc-4d7a-8aec-ec34347cbf53 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:08.456884 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-99ed6b4e-18bc-4d7a-8aec-ec34347cbf53 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:08.465336 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-99ed6b4e-18bc-4d7a-8aec-ec34347cbf53 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:08.465843 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-99ed6b4e-18bc-4d7a-8aec-ec34347cbf53 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:08.466686 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-99ed6b4e-18bc-4d7a-8aec-ec34347cbf53 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:08.467169 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-99ed6b4e-18bc-4d7a-8aec-ec34347cbf53 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:08.569783 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-99ed6b4e-18bc-4d7a-8aec-ec34347cbf53 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28659 microversion: 2.20 time: 0.118591 Apr 15 20:00:08.570454 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 398/880] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:08 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28659 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:00:09.355784 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-14e7bc65-da7a-4efd-a478-152b1bebea78 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:09.356467 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-14e7bc65-da7a-4efd-a478-152b1bebea78 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:09.364860 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-14e7bc65-da7a-4efd-a478-152b1bebea78 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:09.365405 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-14e7bc65-da7a-4efd-a478-152b1bebea78 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:09.366248 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-14e7bc65-da7a-4efd-a478-152b1bebea78 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:09.366745 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-14e7bc65-da7a-4efd-a478-152b1bebea78 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:09.583465 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-89f1db04-ce50-466f-bb11-ed63e1319291 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:09.584725 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-89f1db04-ce50-466f-bb11-ed63e1319291 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:09.593685 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-89f1db04-ce50-466f-bb11-ed63e1319291 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:09.594194 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-89f1db04-ce50-466f-bb11-ed63e1319291 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:09.595041 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-89f1db04-ce50-466f-bb11-ed63e1319291 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:09.595599 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-89f1db04-ce50-466f-bb11-ed63e1319291 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:09.626428 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-14e7bc65-da7a-4efd-a478-152b1bebea78 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:09.637825 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-14e7bc65-da7a-4efd-a478-152b1bebea78 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1671 microversion: 2.1 time: 0.286577 Apr 15 20:00:09.638744 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 483/881] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:00:09 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1671 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 20:00:09.697921 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-89f1db04-ce50-466f-bb11-ed63e1319291 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28659 microversion: 2.20 time: 0.118849 Apr 15 20:00:09.700015 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 399/882] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:09 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28659 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 15 20:00:10.657332 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-acac354e-b789-4997-b698-012ca8713a5b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:10.658004 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-acac354e-b789-4997-b698-012ca8713a5b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:10.666071 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-acac354e-b789-4997-b698-012ca8713a5b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:10.666577 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-acac354e-b789-4997-b698-012ca8713a5b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:10.667558 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-acac354e-b789-4997-b698-012ca8713a5b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:10.668047 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-acac354e-b789-4997-b698-012ca8713a5b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:10.713838 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e95f4495-8bd7-4e2e-8748-4fcea96eaab3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:10.716306 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e95f4495-8bd7-4e2e-8748-4fcea96eaab3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:10.726179 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e95f4495-8bd7-4e2e-8748-4fcea96eaab3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:10.726777 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e95f4495-8bd7-4e2e-8748-4fcea96eaab3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:10.727733 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e95f4495-8bd7-4e2e-8748-4fcea96eaab3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:10.728484 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e95f4495-8bd7-4e2e-8748-4fcea96eaab3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:10.817954 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-acac354e-b789-4997-b698-012ca8713a5b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:10.827913 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e95f4495-8bd7-4e2e-8748-4fcea96eaab3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28659 microversion: 2.20 time: 0.118073 Apr 15 20:00:10.828484 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-acac354e-b789-4997-b698-012ca8713a5b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1604 microversion: 2.1 time: 0.175329 Apr 15 20:00:10.832187 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 484/884] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:00:10 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1604 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:00:10.832344 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 400/884] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:10 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28659 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 15 20:00:11.156761 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-616f12a4-38af-4bca-9c73-3d3b6eec6877 req-f00ef291-02d9-4c00-a3ff-6d173ff89951 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "271550cc-6d60-4503-9d82-cbf32efbd5d9", "name": "network-vif-deleted", "tag": "35f3d958-e117-4a5d-bd05-1e95267c5815"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:11.158767 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:00:11.158767 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:00:11.169783 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-616f12a4-38af-4bca-9c73-3d3b6eec6877 req-f00ef291-02d9-4c00-a3ff-6d173ff89951 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:11.170455 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-616f12a4-38af-4bca-9c73-3d3b6eec6877 req-f00ef291-02d9-4c00-a3ff-6d173ff89951 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:11.191322 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-616f12a4-38af-4bca-9c73-3d3b6eec6877 req-f00ef291-02d9-4c00-a3ff-6d173ff89951 service nova] Creating event network-vif-deleted:35f3d958-e117-4a5d-bd05-1e95267c5815 for instance 271550cc-6d60-4503-9d82-cbf32efbd5d9 on hv-cinder-78638 Apr 15 20:00:11.196990 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-616f12a4-38af-4bca-9c73-3d3b6eec6877 req-f00ef291-02d9-4c00-a3ff-6d173ff89951 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046793 Apr 15 20:00:11.197764 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 401/885] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:00:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:00:11.840868 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-fdf4499f-70ea-4394-8abd-28b366aa738c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:11.842496 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-fdf4499f-70ea-4394-8abd-28b366aa738c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:11.847014 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f45692e1-3767-4989-aa68-9a7bf7785bad tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:11.847974 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f45692e1-3767-4989-aa68-9a7bf7785bad tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:11.851631 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fdf4499f-70ea-4394-8abd-28b366aa738c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:11.852133 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fdf4499f-70ea-4394-8abd-28b366aa738c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:11.853100 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fdf4499f-70ea-4394-8abd-28b366aa738c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:11.853749 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fdf4499f-70ea-4394-8abd-28b366aa738c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:11.856977 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f45692e1-3767-4989-aa68-9a7bf7785bad tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:11.857702 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f45692e1-3767-4989-aa68-9a7bf7785bad tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:11.858775 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f45692e1-3767-4989-aa68-9a7bf7785bad tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:11.859496 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f45692e1-3767-4989-aa68-9a7bf7785bad tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:11.936324 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f45692e1-3767-4989-aa68-9a7bf7785bad tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:11.936872 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f45692e1-3767-4989-aa68-9a7bf7785bad tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:11.937361 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.objects.instance [None req-f45692e1-3767-4989-aa68-9a7bf7785bad tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lazy-loading 'fault' on Instance uuid 271550cc-6d60-4503-9d82-cbf32efbd5d9 {{(pid=99512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 15 20:00:11.966740 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-fdf4499f-70ea-4394-8abd-28b366aa738c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28659 microversion: 2.20 time: 0.129294 Apr 15 20:00:11.967791 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 485/886] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:11 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28659 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:00:12.002189 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7c003ef2-a397-43f5-b524-c45dc21943b1 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1882817170"}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:12.003249 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7c003ef2-a397-43f5-b524-c45dc21943b1 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:12.014211 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7c003ef2-a397-43f5-b524-c45dc21943b1 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:12.014995 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7c003ef2-a397-43f5-b524-c45dc21943b1 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:12.016079 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7c003ef2-a397-43f5-b524-c45dc21943b1 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:12.016971 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7c003ef2-a397-43f5-b524-c45dc21943b1 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:12.029080 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f45692e1-3767-4989-aa68-9a7bf7785bad tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:12.037094 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f45692e1-3767-4989-aa68-9a7bf7785bad tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 200 len: 1327 microversion: 2.1 time: 0.194612 Apr 15 20:00:12.037903 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 402/887] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:00:11 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 1327 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:00:12.238353 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.network.security_group_api [None req-7c003ef2-a397-43f5-b524-c45dc21943b1 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Removing security group bc6b6b69-666b-4890-857e-c2b16a23866b from port 619a8492-f932-4048-8258-fe9757a50525 Apr 15 20:00:12.980286 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-2bf48df1-202d-4c60-847c-24f8f634c48a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:12.982464 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-2bf48df1-202d-4c60-847c-24f8f634c48a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:12.990900 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2bf48df1-202d-4c60-847c-24f8f634c48a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:12.991624 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2bf48df1-202d-4c60-847c-24f8f634c48a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:12.992591 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2bf48df1-202d-4c60-847c-24f8f634c48a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:12.993278 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2bf48df1-202d-4c60-847c-24f8f634c48a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:13.100086 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-2bf48df1-202d-4c60-847c-24f8f634c48a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28659 microversion: 2.20 time: 0.123977 Apr 15 20:00:13.104364 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 403/888] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:12 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28659 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 15 20:00:13.107257 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-30e73867-9587-4c52-b6be-4f69f346697a tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:13.108040 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-30e73867-9587-4c52-b6be-4f69f346697a tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:13.116837 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-30e73867-9587-4c52-b6be-4f69f346697a tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:13.117397 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-30e73867-9587-4c52-b6be-4f69f346697a tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:13.118238 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-30e73867-9587-4c52-b6be-4f69f346697a tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:13.118804 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-30e73867-9587-4c52-b6be-4f69f346697a tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:13.126834 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7c003ef2-a397-43f5-b524-c45dc21943b1 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "POST /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453/action" status: 202 len: 0 microversion: 2.1 time: 1.131143 Apr 15 20:00:13.127617 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 486/889] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:00:11 2021] POST /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453/action => generated 0 bytes in 1133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 15 20:00:13.177038 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-30e73867-9587-4c52-b6be-4f69f346697a tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] HTTP exception thrown: Instance 271550cc-6d60-4503-9d82-cbf32efbd5d9 could not be found. Apr 15 20:00:13.177713 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-30e73867-9587-4c52-b6be-4f69f346697a tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Returning 404 to user: Instance 271550cc-6d60-4503-9d82-cbf32efbd5d9 could not be found. {{(pid=99512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 20:00:13.178613 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-30e73867-9587-4c52-b6be-4f69f346697a tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 404 len: 111 microversion: 2.1 time: 0.076517 Apr 15 20:00:13.183468 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 404/890] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:00:13 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 15 20:00:13.188653 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a10d82a7-eafa-49c9-88dd-7fca81c7ac8f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '.version_select at 0x7f18d82a60d0>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:13.207210 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a10d82a7-eafa-49c9-88dd-7fca81c7ac8f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1011932143" status: 202 len: 0 microversion: 2.1 time: 0.022481 Apr 15 20:00:13.208106 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 487/891] 10.222.0.58 () {58 vars in 1211 bytes} [Thu Apr 15 20:00:13 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1011932143 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:00:13.213466 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-e048fdf7-d7d5-41e6-8611-e288bc9f27b4 req-c8c7ff75-c111-4ad3-8113-c693eff64fad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1ea7a7c-3e3e-47c5-8955-a3b27a52d453", "tag": "619a8492-f932-4048-8258-fe9757a50525"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:13.218438 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:00:13.218438 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:00:13.241138 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-e048fdf7-d7d5-41e6-8611-e288bc9f27b4 req-c8c7ff75-c111-4ad3-8113-c693eff64fad service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:13.241843 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-e048fdf7-d7d5-41e6-8611-e288bc9f27b4 req-c8c7ff75-c111-4ad3-8113-c693eff64fad service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:13.269726 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-e048fdf7-d7d5-41e6-8611-e288bc9f27b4 req-c8c7ff75-c111-4ad3-8113-c693eff64fad service nova] Creating event network-changed:619a8492-f932-4048-8258-fe9757a50525 for instance b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 on hv-cinder-78638 Apr 15 20:00:13.275064 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-e048fdf7-d7d5-41e6-8611-e288bc9f27b4 req-c8c7ff75-c111-4ad3-8113-c693eff64fad service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065671 Apr 15 20:00:13.276965 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 405/892] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:00:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 15 20:00:13.436322 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-1aee7772-0e57-441c-8290-f8c3c77ac05a tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:13.437227 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-1aee7772-0e57-441c-8290-f8c3c77ac05a tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:13.445993 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1aee7772-0e57-441c-8290-f8c3c77ac05a tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:13.446790 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1aee7772-0e57-441c-8290-f8c3c77ac05a tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:13.448031 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1aee7772-0e57-441c-8290-f8c3c77ac05a tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:13.448756 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1aee7772-0e57-441c-8290-f8c3c77ac05a tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:13.527840 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.objects.instance [None req-1aee7772-0e57-441c-8290-f8c3c77ac05a tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lazy-loading 'flavor' on Instance uuid c241efcb-ba90-43dd-a6c3-393b77086172 {{(pid=99511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 15 20:00:13.704442 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-1aee7772-0e57-441c-8290-f8c3c77ac05a tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "POST /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172/action" status: 202 len: 0 microversion: 2.1 time: 0.272197 Apr 15 20:00:13.705028 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 488/893] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:00:13 2021] POST /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:00:13.715314 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-bac83924-02e8-4c33-8eb3-2d458ed3d705 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:13.716590 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-bac83924-02e8-4c33-8eb3-2d458ed3d705 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:13.725942 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bac83924-02e8-4c33-8eb3-2d458ed3d705 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:13.726543 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bac83924-02e8-4c33-8eb3-2d458ed3d705 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:13.727468 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bac83924-02e8-4c33-8eb3-2d458ed3d705 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:13.728478 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bac83924-02e8-4c33-8eb3-2d458ed3d705 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:14.113872 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ca24250d-1362-45be-80bd-0a47b50fe6e3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:14.115526 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ca24250d-1362-45be-80bd-0a47b50fe6e3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:14.124951 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ca24250d-1362-45be-80bd-0a47b50fe6e3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:14.125506 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ca24250d-1362-45be-80bd-0a47b50fe6e3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:14.126486 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ca24250d-1362-45be-80bd-0a47b50fe6e3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:14.127053 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ca24250d-1362-45be-80bd-0a47b50fe6e3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:14.230023 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ca24250d-1362-45be-80bd-0a47b50fe6e3 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28659 microversion: 2.20 time: 0.120902 Apr 15 20:00:14.231179 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 489/894] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:14 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28659 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:00:14.458208 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-bac83924-02e8-4c33-8eb3-2d458ed3d705 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:14.468418 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-bac83924-02e8-4c33-8eb3-2d458ed3d705 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1569 microversion: 2.1 time: 0.758430 Apr 15 20:00:14.469035 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 406/895] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:00:13 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1569 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 20:00:15.243207 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-23703e9f-645a-41b9-adf8-c9f5fec4c23e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:15.244948 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-23703e9f-645a-41b9-adf8-c9f5fec4c23e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:15.253911 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-23703e9f-645a-41b9-adf8-c9f5fec4c23e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:15.254495 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-23703e9f-645a-41b9-adf8-c9f5fec4c23e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:15.255644 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-23703e9f-645a-41b9-adf8-c9f5fec4c23e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:15.256359 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-23703e9f-645a-41b9-adf8-c9f5fec4c23e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:15.307544 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ca8f2b13-6d3e-4d33-99bc-b749fb457ccd tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:15.308392 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ca8f2b13-6d3e-4d33-99bc-b749fb457ccd tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:15.316560 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ca8f2b13-6d3e-4d33-99bc-b749fb457ccd tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:15.317379 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ca8f2b13-6d3e-4d33-99bc-b749fb457ccd tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:15.318426 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ca8f2b13-6d3e-4d33-99bc-b749fb457ccd tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:15.319122 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ca8f2b13-6d3e-4d33-99bc-b749fb457ccd tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:15.372279 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-23703e9f-645a-41b9-adf8-c9f5fec4c23e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28659 microversion: 2.20 time: 0.133304 Apr 15 20:00:15.373324 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 490/896] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:15 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28659 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:00:15.380869 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-6856deba-495f-402f-b86f-7bbd65b5c9f7 req-c8db3f57-d7a9-4922-9666-643786583088 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1ea7a7c-3e3e-47c5-8955-a3b27a52d453", "tag": "619a8492-f932-4048-8258-fe9757a50525"}]} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:15.382513 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:00:15.382513 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:00:15.393509 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-6856deba-495f-402f-b86f-7bbd65b5c9f7 req-c8db3f57-d7a9-4922-9666-643786583088 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:15.394011 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-6856deba-495f-402f-b86f-7bbd65b5c9f7 req-c8db3f57-d7a9-4922-9666-643786583088 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:15.413260 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-6856deba-495f-402f-b86f-7bbd65b5c9f7 req-c8db3f57-d7a9-4922-9666-643786583088 service nova] Creating event network-changed:619a8492-f932-4048-8258-fe9757a50525 for instance b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 on hv-cinder-78638 Apr 15 20:00:15.418625 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-6856deba-495f-402f-b86f-7bbd65b5c9f7 req-c8db3f57-d7a9-4922-9666-643786583088 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044045 Apr 15 20:00:15.419496 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 491/897] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:00:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:00:15.425397 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-753d3134-2566-490d-a322-e6e4edc75ba2 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'create', calling method: .version_select at 0x7f18d375e598>, body: {"keypair": {"name": "tempest-keypair-2060569496"}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:15.449105 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-753d3134-2566-490d-a322-e6e4edc75ba2 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Getting quotas for project fba23e5df9154ee5b97b92e3f9090983. Resources: {'key_pairs'} {{(pid=99511) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 15 20:00:15.453509 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-753d3134-2566-490d-a322-e6e4edc75ba2 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Getting quotas for user c94a8e6666654a7f969179a50453efac and project fba23e5df9154ee5b97b92e3f9090983. Resources: {'key_pairs'} {{(pid=99511) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 15 20:00:15.536920 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.objects.instance [None req-ca8f2b13-6d3e-4d33-99bc-b749fb457ccd tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lazy-loading 'services' on Instance uuid b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 {{(pid=99512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 15 20:00:15.674482 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-753d3134-2566-490d-a322-e6e4edc75ba2 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Getting quotas for project fba23e5df9154ee5b97b92e3f9090983. Resources: {'key_pairs'} {{(pid=99511) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 15 20:00:15.678862 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-753d3134-2566-490d-a322-e6e4edc75ba2 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Getting quotas for user c94a8e6666654a7f969179a50453efac and project fba23e5df9154ee5b97b92e3f9090983. Resources: {'key_pairs'} {{(pid=99511) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 15 20:00:15.687489 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ca8f2b13-6d3e-4d33-99bc-b749fb457ccd tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453/os-volume_attachments/c59deb63-0aea-426b-b2f8-83b066297d9a" status: 202 len: 0 microversion: 2.1 time: 0.384133 Apr 15 20:00:15.690578 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 407/898] 10.222.0.58 () {58 vars in 1406 bytes} [Thu Apr 15 20:00:15 2021] DELETE /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453/os-volume_attachments/c59deb63-0aea-426b-b2f8-83b066297d9a => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:00:15.699084 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-4477132a-9e1f-498a-be3f-5f562d33f2cf tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:15.699908 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-4477132a-9e1f-498a-be3f-5f562d33f2cf tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:15.701147 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-753d3134-2566-490d-a322-e6e4edc75ba2 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.279872 Apr 15 20:00:15.701810 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 492/899] 10.222.0.58 () {60 vars in 1148 bytes} [Thu Apr 15 20:00:15 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:00:15.716103 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6b5f1e88-da13-4a3f-8580-3ca24c14ae48 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:15.717271 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6b5f1e88-da13-4a3f-8580-3ca24c14ae48 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:15.722710 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4477132a-9e1f-498a-be3f-5f562d33f2cf tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:15.723231 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4477132a-9e1f-498a-be3f-5f562d33f2cf tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:15.725864 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4477132a-9e1f-498a-be3f-5f562d33f2cf tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:15.726659 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4477132a-9e1f-498a-be3f-5f562d33f2cf tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:15.739871 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6b5f1e88-da13-4a3f-8580-3ca24c14ae48 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:15.740383 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6b5f1e88-da13-4a3f-8580-3ca24c14ae48 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:15.744714 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6b5f1e88-da13-4a3f-8580-3ca24c14ae48 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:15.745934 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6b5f1e88-da13-4a3f-8580-3ca24c14ae48 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:15.880223 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6b5f1e88-da13-4a3f-8580-3ca24c14ae48 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.168330 Apr 15 20:00:15.881048 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 493/900] 10.222.0.58 () {58 vars in 1292 bytes} [Thu Apr 15 20:00:15 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:00:16.384954 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9c749d2f-0570-4ec7-99e0-261a086eba71 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:16.386763 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9c749d2f-0570-4ec7-99e0-261a086eba71 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:16.395471 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9c749d2f-0570-4ec7-99e0-261a086eba71 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:16.396096 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9c749d2f-0570-4ec7-99e0-261a086eba71 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:16.397140 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9c749d2f-0570-4ec7-99e0-261a086eba71 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:16.397702 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9c749d2f-0570-4ec7-99e0-261a086eba71 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:16.527914 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9c749d2f-0570-4ec7-99e0-261a086eba71 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28659 microversion: 2.20 time: 0.146895 Apr 15 20:00:16.528742 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 494/901] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:16 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28659 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 15 20:00:16.541589 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-4477132a-9e1f-498a-be3f-5f562d33f2cf tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:16.552073 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-4477132a-9e1f-498a-be3f-5f562d33f2cf tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1569 microversion: 2.1 time: 0.860142 Apr 15 20:00:16.552692 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 408/902] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:00:15 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1569 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:00:16.894688 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-826ba0ed-f50a-442f-81a4-0e7f767a30ec tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:16.896233 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-826ba0ed-f50a-442f-81a4-0e7f767a30ec tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:16.906401 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-826ba0ed-f50a-442f-81a4-0e7f767a30ec tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:16.906957 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-826ba0ed-f50a-442f-81a4-0e7f767a30ec tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:16.907885 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-826ba0ed-f50a-442f-81a4-0e7f767a30ec tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:16.908384 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-826ba0ed-f50a-442f-81a4-0e7f767a30ec tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:16.982059 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-826ba0ed-f50a-442f-81a4-0e7f767a30ec tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.091968 Apr 15 20:00:16.982801 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 495/903] 10.222.0.58 () {58 vars in 1292 bytes} [Thu Apr 15 20:00:16 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 15 20:00:16.993650 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-5c14b003-863a-45f1-9648-b32f79235c9a tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:16.994191 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-5c14b003-863a-45f1-9648-b32f79235c9a tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:17.002648 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5c14b003-863a-45f1-9648-b32f79235c9a tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:17.003158 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5c14b003-863a-45f1-9648-b32f79235c9a tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:17.004030 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5c14b003-863a-45f1-9648-b32f79235c9a tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:17.004519 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5c14b003-863a-45f1-9648-b32f79235c9a tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:17.172620 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-5c14b003-863a-45f1-9648-b32f79235c9a tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] HTTP exception thrown: Instance b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 is not attached to volume c59deb63-0aea-426b-b2f8-83b066297d9a Apr 15 20:00:17.173264 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-5c14b003-863a-45f1-9648-b32f79235c9a tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Returning 404 to user: Instance b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 is not attached to volume c59deb63-0aea-426b-b2f8-83b066297d9a {{(pid=99512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 20:00:17.174443 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-5c14b003-863a-45f1-9648-b32f79235c9a tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453/os-volume_attachments/c59deb63-0aea-426b-b2f8-83b066297d9a" status: 404 len: 154 microversion: 2.1 time: 0.185040 Apr 15 20:00:17.175104 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 409/904] 10.222.0.58 () {58 vars in 1406 bytes} [Thu Apr 15 20:00:16 2021] DELETE /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453/os-volume_attachments/c59deb63-0aea-426b-b2f8-83b066297d9a => generated 154 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 15 20:00:17.540901 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-40cbe052-ec32-4c33-9789-efd5b0596f08 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:17.542568 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-40cbe052-ec32-4c33-9789-efd5b0596f08 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:17.550808 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-40cbe052-ec32-4c33-9789-efd5b0596f08 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:17.551314 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-40cbe052-ec32-4c33-9789-efd5b0596f08 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:17.552182 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-40cbe052-ec32-4c33-9789-efd5b0596f08 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:17.552760 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-40cbe052-ec32-4c33-9789-efd5b0596f08 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:17.570132 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6de4479d-ed91-4d81-baeb-79c9e8c10c47 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:17.571049 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6de4479d-ed91-4d81-baeb-79c9e8c10c47 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:17.579337 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6de4479d-ed91-4d81-baeb-79c9e8c10c47 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:17.579824 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6de4479d-ed91-4d81-baeb-79c9e8c10c47 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:17.580989 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6de4479d-ed91-4d81-baeb-79c9e8c10c47 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:17.581579 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6de4479d-ed91-4d81-baeb-79c9e8c10c47 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:17.676736 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-40cbe052-ec32-4c33-9789-efd5b0596f08 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28659 microversion: 2.20 time: 0.140080 Apr 15 20:00:17.678516 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 496/905] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:17 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28659 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:00:18.035668 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-6de4479d-ed91-4d81-baeb-79c9e8c10c47 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:18.045461 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6de4479d-ed91-4d81-baeb-79c9e8c10c47 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1569 microversion: 2.1 time: 0.479314 Apr 15 20:00:18.046089 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 410/906] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:00:17 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1569 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:00:18.313978 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e9378a1d-b42a-41f4-b77a-86f7be658770 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-363408375", "imageRef": "10d66d6e-f687-4228-93d1-67502c9b42e2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "841e7241-ffd3-4269-8bb7-4b3adadc6e3d"}], "security_groups": [{"name": "tempest-securitygroup--712547973"}], "key_name": "tempest-keypair-2060569496", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:18.441306 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-5d31a1ae-9107-469c-821e-c61bac1aece0 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:18.442231 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-5d31a1ae-9107-469c-821e-c61bac1aece0 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:18.450836 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5d31a1ae-9107-469c-821e-c61bac1aece0 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:18.451424 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5d31a1ae-9107-469c-821e-c61bac1aece0 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:18.452370 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5d31a1ae-9107-469c-821e-c61bac1aece0 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:18.452992 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5d31a1ae-9107-469c-821e-c61bac1aece0 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:18.453194 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.network.neutron [None req-e9378a1d-b42a-41f4-b77a-86f7be658770 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] validate_networks() for [('841e7241-ffd3-4269-8bb7-4b3adadc6e3d', None, None, None)] {{(pid=99511) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 15 20:00:18.518633 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-5d31a1ae-9107-469c-821e-c61bac1aece0 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Going to try to terminate instance {{(pid=99512) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 15 20:00:18.632649 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-5d31a1ae-9107-469c-821e-c61bac1aece0 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 204 len: 0 microversion: 2.1 time: 0.194745 Apr 15 20:00:18.633168 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 411/907] 10.222.0.58 () {58 vars in 1229 bytes} [Thu Apr 15 20:00:18 2021] DELETE /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 15 20:00:18.642516 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-02dc3b16-cf3a-40ed-9a08-1a5ead63529c tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:18.643312 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-02dc3b16-cf3a-40ed-9a08-1a5ead63529c tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:18.651087 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-02dc3b16-cf3a-40ed-9a08-1a5ead63529c tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:18.651681 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-02dc3b16-cf3a-40ed-9a08-1a5ead63529c tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:18.652519 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-02dc3b16-cf3a-40ed-9a08-1a5ead63529c tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:18.653004 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-02dc3b16-cf3a-40ed-9a08-1a5ead63529c tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:18.999246 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-02dc3b16-cf3a-40ed-9a08-1a5ead63529c tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:19.008298 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-02dc3b16-cf3a-40ed-9a08-1a5ead63529c tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1554 microversion: 2.1 time: 0.370119 Apr 15 20:00:19.008924 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 412/908] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:00:18 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1554 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 20:00:19.023828 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ee3dea35-6da1-4e4b-8ca1-ad71960e6322 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:19.024961 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ee3dea35-6da1-4e4b-8ca1-ad71960e6322 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:19.032933 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ee3dea35-6da1-4e4b-8ca1-ad71960e6322 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:19.033444 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ee3dea35-6da1-4e4b-8ca1-ad71960e6322 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:19.034285 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ee3dea35-6da1-4e4b-8ca1-ad71960e6322 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:19.034780 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ee3dea35-6da1-4e4b-8ca1-ad71960e6322 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:19.145785 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ee3dea35-6da1-4e4b-8ca1-ad71960e6322 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28659 microversion: 2.20 time: 0.125585 Apr 15 20:00:19.147253 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 413/909] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:19 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28659 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:00:19.147425 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-e9378a1d-b42a-41f4-b77a-86f7be658770 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Flavor limits 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 15 20:00:19.147425 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-e9378a1d-b42a-41f4-b77a-86f7be658770 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Image limits 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 15 20:00:19.148034 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-e9378a1d-b42a-41f4-b77a-86f7be658770 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Flavor pref 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 15 20:00:19.148557 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-e9378a1d-b42a-41f4-b77a-86f7be658770 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Image pref 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 15 20:00:19.149024 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-e9378a1d-b42a-41f4-b77a-86f7be658770 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 15 20:00:19.151866 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-1c7a007a-8d0b-429c-9fd7-cdd110284ec3 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:19.152658 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-1c7a007a-8d0b-429c-9fd7-cdd110284ec3 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:19.158334 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e9378a1d-b42a-41f4-b77a-86f7be658770 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:19.158848 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e9378a1d-b42a-41f4-b77a-86f7be658770 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:19.159764 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e9378a1d-b42a-41f4-b77a-86f7be658770 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:19.160329 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e9378a1d-b42a-41f4-b77a-86f7be658770 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:19.161234 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1c7a007a-8d0b-429c-9fd7-cdd110284ec3 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:19.161697 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1c7a007a-8d0b-429c-9fd7-cdd110284ec3 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:19.162532 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1c7a007a-8d0b-429c-9fd7-cdd110284ec3 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:19.163308 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1c7a007a-8d0b-429c-9fd7-cdd110284ec3 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:19.179662 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-e9378a1d-b42a-41f4-b77a-86f7be658770 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Getting quotas for project fba23e5df9154ee5b97b92e3f9090983. Resources: {'cores', 'instances', 'ram'} {{(pid=99511) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 15 20:00:19.184535 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-e9378a1d-b42a-41f4-b77a-86f7be658770 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Getting quotas for user c94a8e6666654a7f969179a50453efac and project fba23e5df9154ee5b97b92e3f9090983. Resources: {'cores', 'instances', 'ram'} {{(pid=99511) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 15 20:00:19.195819 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e9378a1d-b42a-41f4-b77a-86f7be658770 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Going to run 1 instances... {{(pid=99511) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 15 20:00:19.198575 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e9378a1d-b42a-41f4-b77a-86f7be658770 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='10d66d6e-f687-4228-93d1-67502c9b42e2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 15 20:00:19.250138 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e9378a1d-b42a-41f4-b77a-86f7be658770 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.940990 Apr 15 20:00:19.250992 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 497/910] 10.222.0.58 () {60 vars in 1137 bytes} [Thu Apr 15 20:00:18 2021] POST /compute/v2.1/servers => generated 401 bytes in 943 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 15 20:00:19.263551 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-3fe92abb-0194-45c0-b5ed-df348dbc5d5b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:19.264301 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-3fe92abb-0194-45c0-b5ed-df348dbc5d5b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:19.596466 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3fe92abb-0194-45c0-b5ed-df348dbc5d5b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:19.606260 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-3fe92abb-0194-45c0-b5ed-df348dbc5d5b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0" status: 200 len: 1237 microversion: 2.1 time: 0.346682 Apr 15 20:00:19.606870 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 498/911] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:00:19 2021] GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0 => generated 1237 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:00:19.665823 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-1c7a007a-8d0b-429c-9fd7-cdd110284ec3 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:19.675145 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-1c7a007a-8d0b-429c-9fd7-cdd110284ec3 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1569 microversion: 2.1 time: 0.527305 Apr 15 20:00:19.675837 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 414/912] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:00:19 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1569 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:00:20.027439 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d03f5105-b032-4c69-9acb-2668ce986ba6 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:20.028032 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d03f5105-b032-4c69-9acb-2668ce986ba6 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:20.036154 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d03f5105-b032-4c69-9acb-2668ce986ba6 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:20.036682 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d03f5105-b032-4c69-9acb-2668ce986ba6 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:20.037516 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d03f5105-b032-4c69-9acb-2668ce986ba6 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:20.038261 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d03f5105-b032-4c69-9acb-2668ce986ba6 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:20.160803 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-8d2fe84c-cf85-4bc6-b441-961ca2a11a77 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:20.162619 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-8d2fe84c-cf85-4bc6-b441-961ca2a11a77 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:20.171493 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8d2fe84c-cf85-4bc6-b441-961ca2a11a77 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:20.172010 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8d2fe84c-cf85-4bc6-b441-961ca2a11a77 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:20.172905 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8d2fe84c-cf85-4bc6-b441-961ca2a11a77 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:20.173400 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8d2fe84c-cf85-4bc6-b441-961ca2a11a77 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:20.254587 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d03f5105-b032-4c69-9acb-2668ce986ba6 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:20.263686 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d03f5105-b032-4c69-9acb-2668ce986ba6 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1554 microversion: 2.1 time: 0.240894 Apr 15 20:00:20.264416 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 499/913] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:00:20 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1554 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:00:20.283882 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-8d2fe84c-cf85-4bc6-b441-961ca2a11a77 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28659 microversion: 2.20 time: 0.129139 Apr 15 20:00:20.284675 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 415/914] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:20 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28659 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:00:20.625261 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9ec9e707-0794-4034-b486-6d85f2e48c53 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:20.625978 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9ec9e707-0794-4034-b486-6d85f2e48c53 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:20.634056 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9ec9e707-0794-4034-b486-6d85f2e48c53 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:20.634588 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9ec9e707-0794-4034-b486-6d85f2e48c53 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:20.635427 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9ec9e707-0794-4034-b486-6d85f2e48c53 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:20.636484 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9ec9e707-0794-4034-b486-6d85f2e48c53 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:20.694487 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7f69d4fb-4666-45fa-956c-7d54d33ee755 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:20.695863 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7f69d4fb-4666-45fa-956c-7d54d33ee755 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:20.705907 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7f69d4fb-4666-45fa-956c-7d54d33ee755 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:20.706601 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7f69d4fb-4666-45fa-956c-7d54d33ee755 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:20.707659 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7f69d4fb-4666-45fa-956c-7d54d33ee755 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:20.708304 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7f69d4fb-4666-45fa-956c-7d54d33ee755 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:20.773465 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9ec9e707-0794-4034-b486-6d85f2e48c53 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:20.784214 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9ec9e707-0794-4034-b486-6d85f2e48c53 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0" status: 200 len: 1295 microversion: 2.1 time: 0.163025 Apr 15 20:00:20.791044 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 500/915] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:00:20 2021] GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0 => generated 1295 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:00:21.079166 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-7f69d4fb-4666-45fa-956c-7d54d33ee755 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:21.089716 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7f69d4fb-4666-45fa-956c-7d54d33ee755 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1569 microversion: 2.1 time: 0.399670 Apr 15 20:00:21.090423 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 416/916] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:00:20 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1569 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 20:00:21.282353 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-88d311ef-856b-4386-b5e4-b393b8caeb23 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:21.283411 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-88d311ef-856b-4386-b5e4-b393b8caeb23 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:21.297498 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-de386b93-ecd3-45ef-9fb8-fe01d3328c3c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:21.298656 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-de386b93-ecd3-45ef-9fb8-fe01d3328c3c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:21.302216 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-88d311ef-856b-4386-b5e4-b393b8caeb23 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:21.304749 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-88d311ef-856b-4386-b5e4-b393b8caeb23 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:21.305736 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-88d311ef-856b-4386-b5e4-b393b8caeb23 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:21.308844 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-88d311ef-856b-4386-b5e4-b393b8caeb23 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:21.316416 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-de386b93-ecd3-45ef-9fb8-fe01d3328c3c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:21.317062 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-de386b93-ecd3-45ef-9fb8-fe01d3328c3c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:21.318145 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-de386b93-ecd3-45ef-9fb8-fe01d3328c3c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:21.319363 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-de386b93-ecd3-45ef-9fb8-fe01d3328c3c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:21.433001 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-de386b93-ecd3-45ef-9fb8-fe01d3328c3c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28659 microversion: 2.20 time: 0.138870 Apr 15 20:00:21.433969 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 417/917] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:21 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28659 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 15 20:00:21.522416 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-88d311ef-856b-4386-b5e4-b393b8caeb23 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14fc42f165ba4963903dc11f69ab6ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4982826645345ceb30d47046d10f317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:21.535926 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-88d311ef-856b-4386-b5e4-b393b8caeb23 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 200 len: 1512 microversion: 2.1 time: 0.257313 Apr 15 20:00:21.537259 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 501/918] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:00:21 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 1512 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:00:21.783466 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-f3122db6-9c4c-4071-b2ce-494fa525f30b req-c7ac2aff-6365-4246-be96-8c171bf34849 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1ea7a7c-3e3e-47c5-8955-a3b27a52d453", "name": "network-vif-deleted", "tag": "619a8492-f932-4048-8258-fe9757a50525"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:21.785393 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:00:21.785393 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:00:21.795567 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-f3122db6-9c4c-4071-b2ce-494fa525f30b req-c7ac2aff-6365-4246-be96-8c171bf34849 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:21.796079 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-f3122db6-9c4c-4071-b2ce-494fa525f30b req-c7ac2aff-6365-4246-be96-8c171bf34849 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:21.802302 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d939d443-65f6-4fe2-a7c8-8e7147f0f42a tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:21.802961 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d939d443-65f6-4fe2-a7c8-8e7147f0f42a tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:21.811805 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d939d443-65f6-4fe2-a7c8-8e7147f0f42a tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:21.812323 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d939d443-65f6-4fe2-a7c8-8e7147f0f42a tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:21.813358 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d939d443-65f6-4fe2-a7c8-8e7147f0f42a tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:21.813661 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d939d443-65f6-4fe2-a7c8-8e7147f0f42a tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:21.824403 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-f3122db6-9c4c-4071-b2ce-494fa525f30b req-c7ac2aff-6365-4246-be96-8c171bf34849 service nova] Creating event network-vif-deleted:619a8492-f932-4048-8258-fe9757a50525 for instance b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 on hv-cinder-78638 Apr 15 20:00:21.833294 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-f3122db6-9c4c-4071-b2ce-494fa525f30b req-c7ac2aff-6365-4246-be96-8c171bf34849 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056068 Apr 15 20:00:21.838890 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 418/919] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:00:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:00:22.109138 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-edb333e4-9d4a-4446-a80e-1c55b789c6fe tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:22.109902 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-edb333e4-9d4a-4446-a80e-1c55b789c6fe tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:22.120698 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-edb333e4-9d4a-4446-a80e-1c55b789c6fe tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:22.121211 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-edb333e4-9d4a-4446-a80e-1c55b789c6fe tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:22.122059 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-edb333e4-9d4a-4446-a80e-1c55b789c6fe tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:22.122548 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-edb333e4-9d4a-4446-a80e-1c55b789c6fe tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:22.340196 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d939d443-65f6-4fe2-a7c8-8e7147f0f42a tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:22.349508 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d939d443-65f6-4fe2-a7c8-8e7147f0f42a tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0" status: 200 len: 1362 microversion: 2.1 time: 0.551129 Apr 15 20:00:22.350056 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 502/920] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:00:21 2021] GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0 => generated 1362 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:00:22.445690 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-1eb8ac69-127a-4bbc-b035-09a14a221a8f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:22.446832 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-1eb8ac69-127a-4bbc-b035-09a14a221a8f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:22.455474 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1eb8ac69-127a-4bbc-b035-09a14a221a8f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:22.455993 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1eb8ac69-127a-4bbc-b035-09a14a221a8f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:22.456852 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1eb8ac69-127a-4bbc-b035-09a14a221a8f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:22.457351 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1eb8ac69-127a-4bbc-b035-09a14a221a8f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:22.518589 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-edb333e4-9d4a-4446-a80e-1c55b789c6fe tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:22.528738 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-edb333e4-9d4a-4446-a80e-1c55b789c6fe tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1569 microversion: 2.1 time: 0.424179 Apr 15 20:00:22.529454 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 419/921] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:00:22 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1569 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:00:22.556552 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-1eb8ac69-127a-4bbc-b035-09a14a221a8f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28659 microversion: 2.20 time: 0.114657 Apr 15 20:00:22.557911 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 503/922] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:22 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28659 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 15 20:00:22.750867 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c674d4db-2ff0-40b8-9526-845f9a6ca548 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:22.751578 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c674d4db-2ff0-40b8-9526-845f9a6ca548 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] [instance: b1ea7a7c-3e3e-47c5-8955-a3b27a52d453] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:22.759785 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c674d4db-2ff0-40b8-9526-845f9a6ca548 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:22.760294 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c674d4db-2ff0-40b8-9526-845f9a6ca548 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:22.761190 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c674d4db-2ff0-40b8-9526-845f9a6ca548 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:22.761699 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c674d4db-2ff0-40b8-9526-845f9a6ca548 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:22.817220 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-c674d4db-2ff0-40b8-9526-845f9a6ca548 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] HTTP exception thrown: Instance b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 could not be found. Apr 15 20:00:22.818653 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c674d4db-2ff0-40b8-9526-845f9a6ca548 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Returning 404 to user: Instance b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 could not be found. {{(pid=99512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 20:00:22.819771 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c674d4db-2ff0-40b8-9526-845f9a6ca548 tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453" status: 404 len: 111 microversion: 2.1 time: 0.268250 Apr 15 20:00:22.820547 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 420/923] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:00:22 2021] GET /compute/v2.1/servers/b1ea7a7c-3e3e-47c5-8955-a3b27a52d453 => generated 111 bytes in 270 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 15 20:00:22.832261 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-aa2b49b4-4328-4f72-acc7-8333c422358b tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] Calling method '.version_select at 0x7f18d375eea0>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:22.850243 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-aa2b49b4-4328-4f72-acc7-8333c422358b tempest-TestMinimumBasicScenario-716941350 tempest-TestMinimumBasicScenario-716941350-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-23103788" status: 202 len: 0 microversion: 2.1 time: 0.024677 Apr 15 20:00:22.851148 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 504/924] 10.222.0.58 () {58 vars in 1256 bytes} [Thu Apr 15 20:00:22 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-23103788 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:00:23.248935 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-3aa57620-c55c-471e-8d0b-44c1a2fa204d req-93716428-5609-425c-ae14-caaabae6c6b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60b02d1c-8109-44c4-a030-a1edb69e37e0", "tag": "cbdc0e24-2f5d-4fa7-a4ea-f097683823d9"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:23.251036 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:00:23.251036 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:00:23.260194 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-3aa57620-c55c-471e-8d0b-44c1a2fa204d req-93716428-5609-425c-ae14-caaabae6c6b5 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:23.260766 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-3aa57620-c55c-471e-8d0b-44c1a2fa204d req-93716428-5609-425c-ae14-caaabae6c6b5 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:23.279033 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-3aa57620-c55c-471e-8d0b-44c1a2fa204d req-93716428-5609-425c-ae14-caaabae6c6b5 service nova] Creating event network-changed:cbdc0e24-2f5d-4fa7-a4ea-f097683823d9 for instance 60b02d1c-8109-44c4-a030-a1edb69e37e0 on hv-cinder-78638 Apr 15 20:00:23.285072 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-3aa57620-c55c-471e-8d0b-44c1a2fa204d req-93716428-5609-425c-ae14-caaabae6c6b5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040173 Apr 15 20:00:23.285903 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 421/925] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:00:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:00:23.368063 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e7d8dac3-baf8-4622-81b3-02cdcb705b22 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:23.368889 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e7d8dac3-baf8-4622-81b3-02cdcb705b22 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:23.380228 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e7d8dac3-baf8-4622-81b3-02cdcb705b22 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:23.380892 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e7d8dac3-baf8-4622-81b3-02cdcb705b22 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:23.382792 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e7d8dac3-baf8-4622-81b3-02cdcb705b22 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:23.383645 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e7d8dac3-baf8-4622-81b3-02cdcb705b22 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:23.547603 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-3ea0b0b5-01ce-4d0a-9fcd-419e4687265f tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:23.548558 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-3ea0b0b5-01ce-4d0a-9fcd-419e4687265f tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:23.559770 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3ea0b0b5-01ce-4d0a-9fcd-419e4687265f tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:23.560434 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3ea0b0b5-01ce-4d0a-9fcd-419e4687265f tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:23.561397 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3ea0b0b5-01ce-4d0a-9fcd-419e4687265f tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:23.562002 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3ea0b0b5-01ce-4d0a-9fcd-419e4687265f tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:24.063193 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-e7d8dac3-baf8-4622-81b3-02cdcb705b22 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:24.084509 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e7d8dac3-baf8-4622-81b3-02cdcb705b22 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0" status: 200 len: 1362 microversion: 2.1 time: 0.721504 Apr 15 20:00:24.085473 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 505/926] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:00:23 2021] GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0 => generated 1362 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:00:24.101739 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-fee9724f-6ced-4689-a22d-bd092064ddda tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:24.103538 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-fee9724f-6ced-4689-a22d-bd092064ddda tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:24.114799 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fee9724f-6ced-4689-a22d-bd092064ddda tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:24.115762 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fee9724f-6ced-4689-a22d-bd092064ddda tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:24.116903 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fee9724f-6ced-4689-a22d-bd092064ddda tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:24.117651 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fee9724f-6ced-4689-a22d-bd092064ddda tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:24.224289 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-fee9724f-6ced-4689-a22d-bd092064ddda tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28659 microversion: 2.20 time: 0.126453 Apr 15 20:00:24.225845 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 506/927] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:24 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28659 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:00:24.231347 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3ea0b0b5-01ce-4d0a-9fcd-419e4687265f tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:24.243571 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-3ea0b0b5-01ce-4d0a-9fcd-419e4687265f tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1569 microversion: 2.1 time: 0.700332 Apr 15 20:00:24.244557 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 422/928] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:00:23 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1569 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:00:25.105196 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-12f7049d-523e-4d5e-9e82-93add997a270 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:25.106246 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-12f7049d-523e-4d5e-9e82-93add997a270 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:25.114929 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-12f7049d-523e-4d5e-9e82-93add997a270 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:25.115713 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-12f7049d-523e-4d5e-9e82-93add997a270 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:25.116556 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-12f7049d-523e-4d5e-9e82-93add997a270 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:25.117528 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-12f7049d-523e-4d5e-9e82-93add997a270 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:25.238335 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c0f6deb6-0738-40c9-a38f-f77e4eb10091 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:25.239842 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c0f6deb6-0738-40c9-a38f-f77e4eb10091 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:25.254855 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c0f6deb6-0738-40c9-a38f-f77e4eb10091 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:25.258021 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c0f6deb6-0738-40c9-a38f-f77e4eb10091 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:25.259663 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c0f6deb6-0738-40c9-a38f-f77e4eb10091 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:25.260350 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c0f6deb6-0738-40c9-a38f-f77e4eb10091 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:25.358149 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-12f7049d-523e-4d5e-9e82-93add997a270 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:25.368404 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-12f7049d-523e-4d5e-9e82-93add997a270 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0" status: 200 len: 1362 microversion: 2.1 time: 0.267809 Apr 15 20:00:25.369023 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 507/929] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:00:25 2021] GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0 => generated 1362 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:00:25.376095 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c0f6deb6-0738-40c9-a38f-f77e4eb10091 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28659 microversion: 2.20 time: 0.142341 Apr 15 20:00:25.377365 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 423/930] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:25 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28659 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:00:25.378247 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a0075727-065f-46ba-aec2-1d28632dceb2 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:25.379022 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a0075727-065f-46ba-aec2-1d28632dceb2 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:25.388393 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a0075727-065f-46ba-aec2-1d28632dceb2 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:25.388900 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a0075727-065f-46ba-aec2-1d28632dceb2 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:25.389747 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a0075727-065f-46ba-aec2-1d28632dceb2 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:25.390236 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a0075727-065f-46ba-aec2-1d28632dceb2 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:25.602426 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a0075727-065f-46ba-aec2-1d28632dceb2 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:25.612616 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a0075727-065f-46ba-aec2-1d28632dceb2 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1569 microversion: 2.1 time: 0.242552 Apr 15 20:00:25.613242 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 508/931] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:00:25 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1569 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:00:26.391135 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7c616a40-b05e-44af-8e64-406e96c6f18e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:26.396516 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c38d9112-6ab9-400d-bdc2-e6d9923962c5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:26.397203 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c38d9112-6ab9-400d-bdc2-e6d9923962c5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:26.400684 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7c616a40-b05e-44af-8e64-406e96c6f18e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:26.413407 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c38d9112-6ab9-400d-bdc2-e6d9923962c5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:26.413928 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c38d9112-6ab9-400d-bdc2-e6d9923962c5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:26.414794 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c38d9112-6ab9-400d-bdc2-e6d9923962c5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:26.415314 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c38d9112-6ab9-400d-bdc2-e6d9923962c5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:26.423227 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7c616a40-b05e-44af-8e64-406e96c6f18e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:26.423795 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7c616a40-b05e-44af-8e64-406e96c6f18e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:26.424656 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7c616a40-b05e-44af-8e64-406e96c6f18e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:26.425159 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7c616a40-b05e-44af-8e64-406e96c6f18e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:26.542709 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7c616a40-b05e-44af-8e64-406e96c6f18e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28659 microversion: 2.20 time: 0.156539 Apr 15 20:00:26.544928 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 424/932] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:26 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28659 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:00:26.632683 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-8cbb7268-326b-4a92-843a-e0389032dae9 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:26.633509 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-8cbb7268-326b-4a92-843a-e0389032dae9 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:26.643376 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8cbb7268-326b-4a92-843a-e0389032dae9 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:26.643988 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8cbb7268-326b-4a92-843a-e0389032dae9 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:26.644915 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8cbb7268-326b-4a92-843a-e0389032dae9 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:26.645474 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8cbb7268-326b-4a92-843a-e0389032dae9 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:26.657365 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c38d9112-6ab9-400d-bdc2-e6d9923962c5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:26.667661 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c38d9112-6ab9-400d-bdc2-e6d9923962c5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0" status: 200 len: 1362 microversion: 2.1 time: 0.274988 Apr 15 20:00:26.668313 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 509/933] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:00:26 2021] GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0 => generated 1362 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:00:26.862893 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-8cbb7268-326b-4a92-843a-e0389032dae9 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:26.872621 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-8cbb7268-326b-4a92-843a-e0389032dae9 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1569 microversion: 2.1 time: 0.244766 Apr 15 20:00:26.873255 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 425/934] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:00:26 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1569 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:00:27.555849 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-25e38792-5c18-404f-bb27-7184c5b42248 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:27.556984 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-25e38792-5c18-404f-bb27-7184c5b42248 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:27.565026 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-25e38792-5c18-404f-bb27-7184c5b42248 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:27.565543 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-25e38792-5c18-404f-bb27-7184c5b42248 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:27.566390 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-25e38792-5c18-404f-bb27-7184c5b42248 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:27.566890 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-25e38792-5c18-404f-bb27-7184c5b42248 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:27.679456 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-25e38792-5c18-404f-bb27-7184c5b42248 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28659 microversion: 2.20 time: 0.127666 Apr 15 20:00:27.680149 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 510/935] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:27 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28659 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:00:27.687651 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-8b552745-6297-43de-8659-1353a7e77e5a tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:27.688670 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-8b552745-6297-43de-8659-1353a7e77e5a tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:27.701090 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8b552745-6297-43de-8659-1353a7e77e5a tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:27.701601 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8b552745-6297-43de-8659-1353a7e77e5a tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:27.703149 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8b552745-6297-43de-8659-1353a7e77e5a tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:27.703961 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8b552745-6297-43de-8659-1353a7e77e5a tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:27.893963 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d305f927-87e5-40e8-a2b9-eccfcdfe6ce7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:27.894732 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d305f927-87e5-40e8-a2b9-eccfcdfe6ce7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:27.906183 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d305f927-87e5-40e8-a2b9-eccfcdfe6ce7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:27.915529 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d305f927-87e5-40e8-a2b9-eccfcdfe6ce7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:27.917340 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d305f927-87e5-40e8-a2b9-eccfcdfe6ce7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:27.917945 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d305f927-87e5-40e8-a2b9-eccfcdfe6ce7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:28.023941 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-8b552745-6297-43de-8659-1353a7e77e5a tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:28.034200 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-8b552745-6297-43de-8659-1353a7e77e5a tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0" status: 200 len: 1362 microversion: 2.1 time: 0.351756 Apr 15 20:00:28.034855 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 426/936] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:00:27 2021] GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0 => generated 1362 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:00:28.172242 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d305f927-87e5-40e8-a2b9-eccfcdfe6ce7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:28.191726 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d305f927-87e5-40e8-a2b9-eccfcdfe6ce7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1570 microversion: 2.1 time: 0.302381 Apr 15 20:00:28.192579 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 511/937] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:00:27 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1570 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:00:28.210231 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b2a62083-c3fd-41fa-98f0-66e3267f2a5d tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:28.210867 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b2a62083-c3fd-41fa-98f0-66e3267f2a5d tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:28.219969 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b2a62083-c3fd-41fa-98f0-66e3267f2a5d tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:28.220485 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b2a62083-c3fd-41fa-98f0-66e3267f2a5d tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:28.221334 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b2a62083-c3fd-41fa-98f0-66e3267f2a5d tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:28.221830 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b2a62083-c3fd-41fa-98f0-66e3267f2a5d tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:28.381587 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b2a62083-c3fd-41fa-98f0-66e3267f2a5d tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "POST /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172/action" status: 202 len: 0 microversion: 2.1 time: 0.175408 Apr 15 20:00:28.383025 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 427/938] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:00:28 2021] POST /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:00:28.394324 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f214ae1d-ec84-4363-96bc-4fd78852d611 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:28.395006 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f214ae1d-ec84-4363-96bc-4fd78852d611 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:28.414086 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f214ae1d-ec84-4363-96bc-4fd78852d611 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:28.417398 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f214ae1d-ec84-4363-96bc-4fd78852d611 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:28.418299 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f214ae1d-ec84-4363-96bc-4fd78852d611 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:28.418801 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f214ae1d-ec84-4363-96bc-4fd78852d611 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:28.695031 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f214ae1d-ec84-4363-96bc-4fd78852d611 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:28.699923 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-56acbf01-76aa-451d-94cc-de06af693bed tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:28.701347 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-56acbf01-76aa-451d-94cc-de06af693bed tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:28.710939 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f214ae1d-ec84-4363-96bc-4fd78852d611 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1518 microversion: 2.1 time: 0.323278 Apr 15 20:00:28.727216 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 512/939] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:00:28 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1518 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:00:28.730737 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-56acbf01-76aa-451d-94cc-de06af693bed tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:28.731249 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-56acbf01-76aa-451d-94cc-de06af693bed tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:28.732415 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-56acbf01-76aa-451d-94cc-de06af693bed tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:28.732618 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-56acbf01-76aa-451d-94cc-de06af693bed tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:28.847180 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-56acbf01-76aa-451d-94cc-de06af693bed tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28659 microversion: 2.20 time: 0.158746 Apr 15 20:00:28.847932 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 428/940] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:28 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28659 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 15 20:00:29.052140 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-09ecce25-103b-4c1c-9c07-5fc96fc5fc60 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:29.053088 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-09ecce25-103b-4c1c-9c07-5fc96fc5fc60 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:29.062997 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-09ecce25-103b-4c1c-9c07-5fc96fc5fc60 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:29.063629 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-09ecce25-103b-4c1c-9c07-5fc96fc5fc60 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:29.064562 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-09ecce25-103b-4c1c-9c07-5fc96fc5fc60 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:29.065181 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-09ecce25-103b-4c1c-9c07-5fc96fc5fc60 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:29.493832 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-09ecce25-103b-4c1c-9c07-5fc96fc5fc60 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:29.503611 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-09ecce25-103b-4c1c-9c07-5fc96fc5fc60 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0" status: 200 len: 1362 microversion: 2.1 time: 0.455425 Apr 15 20:00:29.504459 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 513/941] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:00:29 2021] GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0 => generated 1362 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:00:29.857893 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e66841cc-f55c-4ef0-a0df-cd5a43e90008 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:29.858668 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e66841cc-f55c-4ef0-a0df-cd5a43e90008 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:29.860278 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f4ecac78-a9be-4a8c-a3bd-7dddfaa18704 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:29.861410 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f4ecac78-a9be-4a8c-a3bd-7dddfaa18704 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:29.867795 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e66841cc-f55c-4ef0-a0df-cd5a43e90008 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:29.868192 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e66841cc-f55c-4ef0-a0df-cd5a43e90008 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:29.869082 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e66841cc-f55c-4ef0-a0df-cd5a43e90008 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:29.869577 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e66841cc-f55c-4ef0-a0df-cd5a43e90008 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:29.870870 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f4ecac78-a9be-4a8c-a3bd-7dddfaa18704 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:29.871495 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f4ecac78-a9be-4a8c-a3bd-7dddfaa18704 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:29.882347 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f4ecac78-a9be-4a8c-a3bd-7dddfaa18704 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:29.885412 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f4ecac78-a9be-4a8c-a3bd-7dddfaa18704 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:30.020765 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f4ecac78-a9be-4a8c-a3bd-7dddfaa18704 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28659 microversion: 2.20 time: 0.164465 Apr 15 20:00:30.021815 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 514/942] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:29 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28659 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:00:30.338319 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-e66841cc-f55c-4ef0-a0df-cd5a43e90008 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:30.354681 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e66841cc-f55c-4ef0-a0df-cd5a43e90008 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1520 microversion: 2.1 time: 0.624597 Apr 15 20:00:30.367256 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 429/943] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:00:29 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1520 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:00:30.526573 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-35a29d5f-cb65-4e26-8bab-693f899e5e2f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:30.527462 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-35a29d5f-cb65-4e26-8bab-693f899e5e2f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:30.540253 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-35a29d5f-cb65-4e26-8bab-693f899e5e2f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:30.540773 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-35a29d5f-cb65-4e26-8bab-693f899e5e2f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:30.541676 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-35a29d5f-cb65-4e26-8bab-693f899e5e2f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:30.542683 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-35a29d5f-cb65-4e26-8bab-693f899e5e2f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:31.033972 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-70f5fdfc-8da9-4c0f-a734-f539b0c09bbd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:31.035205 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-70f5fdfc-8da9-4c0f-a734-f539b0c09bbd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:31.044725 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-70f5fdfc-8da9-4c0f-a734-f539b0c09bbd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:31.045334 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-70f5fdfc-8da9-4c0f-a734-f539b0c09bbd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:31.046284 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-70f5fdfc-8da9-4c0f-a734-f539b0c09bbd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:31.046853 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-70f5fdfc-8da9-4c0f-a734-f539b0c09bbd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:31.131873 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-35a29d5f-cb65-4e26-8bab-693f899e5e2f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:31.141769 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-35a29d5f-cb65-4e26-8bab-693f899e5e2f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0" status: 200 len: 1362 microversion: 2.1 time: 0.622130 Apr 15 20:00:31.142722 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 515/944] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:00:30 2021] GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0 => generated 1362 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:00:31.153624 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-70f5fdfc-8da9-4c0f-a734-f539b0c09bbd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28659 microversion: 2.20 time: 0.124429 Apr 15 20:00:31.155129 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 430/945] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:31 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28659 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 15 20:00:31.378639 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ec86eb17-6f0d-46bd-9e2b-8d136d82cbdb tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:31.383729 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ec86eb17-6f0d-46bd-9e2b-8d136d82cbdb tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:31.392410 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ec86eb17-6f0d-46bd-9e2b-8d136d82cbdb tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:31.392916 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ec86eb17-6f0d-46bd-9e2b-8d136d82cbdb tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:31.393762 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ec86eb17-6f0d-46bd-9e2b-8d136d82cbdb tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:31.394545 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ec86eb17-6f0d-46bd-9e2b-8d136d82cbdb tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:31.557589 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-ac3c07c3-49d1-445b-af10-36513e13192d req-906d4dbb-c7bd-448e-88f7-aaf169c055fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60b02d1c-8109-44c4-a030-a1edb69e37e0", "name": "network-vif-plugged", "status": "completed", "tag": "cbdc0e24-2f5d-4fa7-a4ea-f097683823d9"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:31.559544 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:00:31.559544 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:00:31.569657 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-ac3c07c3-49d1-445b-af10-36513e13192d req-906d4dbb-c7bd-448e-88f7-aaf169c055fd service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:31.570164 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-ac3c07c3-49d1-445b-af10-36513e13192d req-906d4dbb-c7bd-448e-88f7-aaf169c055fd service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:31.588978 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-ac3c07c3-49d1-445b-af10-36513e13192d req-906d4dbb-c7bd-448e-88f7-aaf169c055fd service nova] Creating event network-vif-plugged:cbdc0e24-2f5d-4fa7-a4ea-f097683823d9 for instance 60b02d1c-8109-44c4-a030-a1edb69e37e0 on hv-cinder-78638 Apr 15 20:00:31.594153 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-ac3c07c3-49d1-445b-af10-36513e13192d req-906d4dbb-c7bd-448e-88f7-aaf169c055fd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041383 Apr 15 20:00:31.594823 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 431/946] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:00:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 15 20:00:31.657435 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ec86eb17-6f0d-46bd-9e2b-8d136d82cbdb tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:31.680049 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ec86eb17-6f0d-46bd-9e2b-8d136d82cbdb tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1576 microversion: 2.1 time: 0.309053 Apr 15 20:00:31.680806 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 516/947] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:00:31 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1576 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:00:32.161123 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ded96239-d961-4535-ae46-a6ec0a7d08f6 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:32.161910 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ded96239-d961-4535-ae46-a6ec0a7d08f6 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:32.166843 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c681c75e-c41b-4aa6-8b17-efc96986b5ad tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:32.167653 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c681c75e-c41b-4aa6-8b17-efc96986b5ad tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:32.170326 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ded96239-d961-4535-ae46-a6ec0a7d08f6 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:32.170885 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ded96239-d961-4535-ae46-a6ec0a7d08f6 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:32.171801 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ded96239-d961-4535-ae46-a6ec0a7d08f6 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:32.172517 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ded96239-d961-4535-ae46-a6ec0a7d08f6 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:32.176178 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c681c75e-c41b-4aa6-8b17-efc96986b5ad tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:32.176696 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c681c75e-c41b-4aa6-8b17-efc96986b5ad tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:32.177551 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c681c75e-c41b-4aa6-8b17-efc96986b5ad tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:32.178102 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c681c75e-c41b-4aa6-8b17-efc96986b5ad tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:32.275897 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c681c75e-c41b-4aa6-8b17-efc96986b5ad tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28659 microversion: 2.20 time: 0.113348 Apr 15 20:00:32.276847 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 517/948] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:32 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28659 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 15 20:00:32.643152 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ded96239-d961-4535-ae46-a6ec0a7d08f6 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:32.652290 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ded96239-d961-4535-ae46-a6ec0a7d08f6 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0" status: 200 len: 1362 microversion: 2.1 time: 0.495966 Apr 15 20:00:32.652986 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 432/949] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:00:32 2021] GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0 => generated 1362 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:00:32.699382 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6ae94c25-d683-4f22-a233-70ce81ee19d6 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:32.700072 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6ae94c25-d683-4f22-a233-70ce81ee19d6 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:32.708589 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6ae94c25-d683-4f22-a233-70ce81ee19d6 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:32.709096 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6ae94c25-d683-4f22-a233-70ce81ee19d6 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:32.709947 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6ae94c25-d683-4f22-a233-70ce81ee19d6 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:32.710699 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6ae94c25-d683-4f22-a233-70ce81ee19d6 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:32.925875 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-6ae94c25-d683-4f22-a233-70ce81ee19d6 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:32.935252 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6ae94c25-d683-4f22-a233-70ce81ee19d6 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1576 microversion: 2.1 time: 0.240756 Apr 15 20:00:32.935899 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 518/950] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:00:32 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1576 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:00:33.288736 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-4167291c-8cf4-47d2-a24c-01676bebd081 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:33.289786 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-4167291c-8cf4-47d2-a24c-01676bebd081 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:33.297681 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4167291c-8cf4-47d2-a24c-01676bebd081 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:33.298199 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4167291c-8cf4-47d2-a24c-01676bebd081 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:33.299047 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4167291c-8cf4-47d2-a24c-01676bebd081 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:33.299606 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4167291c-8cf4-47d2-a24c-01676bebd081 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:33.398660 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-4167291c-8cf4-47d2-a24c-01676bebd081 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28659 microversion: 2.20 time: 0.114101 Apr 15 20:00:33.399384 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 433/951] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:33 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28659 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:00:33.636072 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-72bdca70-455c-4031-b56f-580158e95fde req-8fb2d7c1-cc0e-4d58-9140-3cb4e81e8ea7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c241efcb-ba90-43dd-a6c3-393b77086172", "name": "network-vif-unplugged", "status": "completed", "tag": "32a87087-67a6-454d-8830-c295f0d8e889"}]} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:33.637775 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:00:33.637775 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:00:33.646700 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-72bdca70-455c-4031-b56f-580158e95fde req-8fb2d7c1-cc0e-4d58-9140-3cb4e81e8ea7 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:33.647203 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-72bdca70-455c-4031-b56f-580158e95fde req-8fb2d7c1-cc0e-4d58-9140-3cb4e81e8ea7 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:33.664477 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-72bdca70-455c-4031-b56f-580158e95fde req-8fb2d7c1-cc0e-4d58-9140-3cb4e81e8ea7 service nova] Creating event network-vif-unplugged:32a87087-67a6-454d-8830-c295f0d8e889 for instance c241efcb-ba90-43dd-a6c3-393b77086172 on hv-cinder-78638 Apr 15 20:00:33.669719 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-72bdca70-455c-4031-b56f-580158e95fde req-8fb2d7c1-cc0e-4d58-9140-3cb4e81e8ea7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038256 Apr 15 20:00:33.670672 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 519/952] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:00:33 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:00:33.672466 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-4342daf9-7041-468d-9a4e-73bf7c0cf195 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:33.673242 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-4342daf9-7041-468d-9a4e-73bf7c0cf195 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:33.682012 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4342daf9-7041-468d-9a4e-73bf7c0cf195 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:33.683021 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4342daf9-7041-468d-9a4e-73bf7c0cf195 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:33.683884 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4342daf9-7041-468d-9a4e-73bf7c0cf195 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:33.684376 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4342daf9-7041-468d-9a4e-73bf7c0cf195 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:33.896395 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-4342daf9-7041-468d-9a4e-73bf7c0cf195 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:33.905442 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-4342daf9-7041-468d-9a4e-73bf7c0cf195 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0" status: 200 len: 1546 microversion: 2.1 time: 0.239069 Apr 15 20:00:33.906073 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 434/953] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:00:33 2021] GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0 => generated 1546 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:00:33.924891 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6d55d9ee-9eb9-4474-b60f-49f35fbb4e7f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:33.925559 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6d55d9ee-9eb9-4474-b60f-49f35fbb4e7f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:33.934427 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6d55d9ee-9eb9-4474-b60f-49f35fbb4e7f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:33.934931 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6d55d9ee-9eb9-4474-b60f-49f35fbb4e7f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:33.935836 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6d55d9ee-9eb9-4474-b60f-49f35fbb4e7f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:33.936333 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6d55d9ee-9eb9-4474-b60f-49f35fbb4e7f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:33.953438 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f90826ae-79e2-467a-b4d5-3ef6977f0050 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:33.954131 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f90826ae-79e2-467a-b4d5-3ef6977f0050 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:33.962001 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f90826ae-79e2-467a-b4d5-3ef6977f0050 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:33.962513 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f90826ae-79e2-467a-b4d5-3ef6977f0050 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:33.963421 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f90826ae-79e2-467a-b4d5-3ef6977f0050 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:33.963921 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f90826ae-79e2-467a-b4d5-3ef6977f0050 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:34.165464 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6d55d9ee-9eb9-4474-b60f-49f35fbb4e7f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.245694 Apr 15 20:00:34.167681 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 520/954] 10.222.0.58 () {58 vars in 1265 bytes} [Thu Apr 15 20:00:33 2021] GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/os-interface => generated 284 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:00:34.411883 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-478fd39d-c908-4402-9c80-121a34a8b962 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:34.413184 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-478fd39d-c908-4402-9c80-121a34a8b962 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:34.421721 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-478fd39d-c908-4402-9c80-121a34a8b962 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:34.422235 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-478fd39d-c908-4402-9c80-121a34a8b962 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:34.423101 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-478fd39d-c908-4402-9c80-121a34a8b962 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:34.423620 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-478fd39d-c908-4402-9c80-121a34a8b962 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:34.428413 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f90826ae-79e2-467a-b4d5-3ef6977f0050 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:34.445927 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f90826ae-79e2-467a-b4d5-3ef6977f0050 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1576 microversion: 2.1 time: 0.496776 Apr 15 20:00:34.446679 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 435/955] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:00:33 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1576 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 20:00:34.529842 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-478fd39d-c908-4402-9c80-121a34a8b962 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28659 microversion: 2.20 time: 0.121723 Apr 15 20:00:34.531024 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 521/956] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:34 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28659 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:00:35.464247 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6df30f8a-fe76-482a-9f29-8771ae20afc3 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:35.465618 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6df30f8a-fe76-482a-9f29-8771ae20afc3 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:35.473898 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6df30f8a-fe76-482a-9f29-8771ae20afc3 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:35.474413 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6df30f8a-fe76-482a-9f29-8771ae20afc3 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:35.475339 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6df30f8a-fe76-482a-9f29-8771ae20afc3 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:35.475852 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6df30f8a-fe76-482a-9f29-8771ae20afc3 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:35.546148 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-10d8b082-9d29-4dd1-8b15-c5f6bee12680 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:35.547640 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-10d8b082-9d29-4dd1-8b15-c5f6bee12680 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:35.558657 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-10d8b082-9d29-4dd1-8b15-c5f6bee12680 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:35.559429 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-10d8b082-9d29-4dd1-8b15-c5f6bee12680 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:35.560481 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-10d8b082-9d29-4dd1-8b15-c5f6bee12680 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:35.561165 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-10d8b082-9d29-4dd1-8b15-c5f6bee12680 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:35.670529 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-10d8b082-9d29-4dd1-8b15-c5f6bee12680 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28659 microversion: 2.20 time: 0.131305 Apr 15 20:00:35.671645 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 522/957] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:35 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28659 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:00:35.972200 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-6df30f8a-fe76-482a-9f29-8771ae20afc3 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:35.982523 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6df30f8a-fe76-482a-9f29-8771ae20afc3 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1576 microversion: 2.1 time: 0.522337 Apr 15 20:00:35.983837 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 436/958] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:00:35 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1576 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:00:36.164529 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c2cddf36-2d48-4276-854e-26b465cc62ba tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:36.165664 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c2cddf36-2d48-4276-854e-26b465cc62ba tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:36.178390 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c2cddf36-2d48-4276-854e-26b465cc62ba tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:36.178901 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c2cddf36-2d48-4276-854e-26b465cc62ba tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:36.179775 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c2cddf36-2d48-4276-854e-26b465cc62ba tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:36.180404 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c2cddf36-2d48-4276-854e-26b465cc62ba tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:36.181316 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-14ffc317-ebce-404f-a0ec-185c79ea5eae req-f02cdb59-d8a1-4c55-bfa3-d32eb11911cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60b02d1c-8109-44c4-a030-a1edb69e37e0", "tag": "cbdc0e24-2f5d-4fa7-a4ea-f097683823d9"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:36.183657 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:00:36.183657 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:00:36.196950 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-14ffc317-ebce-404f-a0ec-185c79ea5eae req-f02cdb59-d8a1-4c55-bfa3-d32eb11911cd service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:36.197385 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-14ffc317-ebce-404f-a0ec-185c79ea5eae req-f02cdb59-d8a1-4c55-bfa3-d32eb11911cd service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:36.217068 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-14ffc317-ebce-404f-a0ec-185c79ea5eae req-f02cdb59-d8a1-4c55-bfa3-d32eb11911cd service nova] Creating event network-changed:cbdc0e24-2f5d-4fa7-a4ea-f097683823d9 for instance 60b02d1c-8109-44c4-a030-a1edb69e37e0 on hv-cinder-78638 Apr 15 20:00:36.222445 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-14ffc317-ebce-404f-a0ec-185c79ea5eae req-f02cdb59-d8a1-4c55-bfa3-d32eb11911cd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046862 Apr 15 20:00:36.223525 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 437/959] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:00:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:00:36.295005 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c2cddf36-2d48-4276-854e-26b465cc62ba tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 14 microversion: 2.1 time: 0.135012 Apr 15 20:00:36.298869 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 523/960] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:00:36 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 14 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 15 20:00:36.685933 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ad4b206c-b4f9-4c35-98b1-b3ad7a357d7d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:36.687737 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ad4b206c-b4f9-4c35-98b1-b3ad7a357d7d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:36.713531 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ad4b206c-b4f9-4c35-98b1-b3ad7a357d7d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:36.714122 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ad4b206c-b4f9-4c35-98b1-b3ad7a357d7d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:36.715009 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ad4b206c-b4f9-4c35-98b1-b3ad7a357d7d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:36.715528 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ad4b206c-b4f9-4c35-98b1-b3ad7a357d7d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:36.829881 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ad4b206c-b4f9-4c35-98b1-b3ad7a357d7d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 28691 microversion: 2.20 time: 0.150191 Apr 15 20:00:36.830761 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 438/961] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:36 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 28691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:00:37.003367 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-dfb14f4f-0ac4-49b0-95ee-19bf0f745b21 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:37.004312 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-dfb14f4f-0ac4-49b0-95ee-19bf0f745b21 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:37.013879 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dfb14f4f-0ac4-49b0-95ee-19bf0f745b21 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:37.014712 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dfb14f4f-0ac4-49b0-95ee-19bf0f745b21 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:37.015705 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dfb14f4f-0ac4-49b0-95ee-19bf0f745b21 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:37.016217 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dfb14f4f-0ac4-49b0-95ee-19bf0f745b21 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:37.249458 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-dfb14f4f-0ac4-49b0-95ee-19bf0f745b21 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:37.259056 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-dfb14f4f-0ac4-49b0-95ee-19bf0f745b21 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1576 microversion: 2.1 time: 0.261789 Apr 15 20:00:37.259959 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 524/962] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:00:36 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1576 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:00:37.307329 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a319d2f2-9452-4f16-b572-154fedbfaa39 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:37.308601 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a319d2f2-9452-4f16-b572-154fedbfaa39 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:37.319929 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a319d2f2-9452-4f16-b572-154fedbfaa39 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:37.320439 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a319d2f2-9452-4f16-b572-154fedbfaa39 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:37.321282 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a319d2f2-9452-4f16-b572-154fedbfaa39 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:37.321912 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a319d2f2-9452-4f16-b572-154fedbfaa39 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:37.424479 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a319d2f2-9452-4f16-b572-154fedbfaa39 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 14 microversion: 2.1 time: 0.121627 Apr 15 20:00:37.427911 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 439/963] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:00:37 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 15 20:00:37.852506 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b873afdc-560c-4106-8692-aec526cef0f5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:37.854377 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b873afdc-560c-4106-8692-aec526cef0f5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:37.866652 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b873afdc-560c-4106-8692-aec526cef0f5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:37.867439 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b873afdc-560c-4106-8692-aec526cef0f5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:37.868505 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b873afdc-560c-4106-8692-aec526cef0f5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:37.869201 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b873afdc-560c-4106-8692-aec526cef0f5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:38.042340 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b873afdc-560c-4106-8692-aec526cef0f5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 30919 microversion: 2.20 time: 0.203492 Apr 15 20:00:38.046764 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 525/964] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:37 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 30919 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:00:38.278307 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-87af49f4-908f-4718-b1c4-faa96388124f tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:38.279203 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-87af49f4-908f-4718-b1c4-faa96388124f tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:38.288035 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-87af49f4-908f-4718-b1c4-faa96388124f tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:38.288547 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-87af49f4-908f-4718-b1c4-faa96388124f tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:38.289387 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-87af49f4-908f-4718-b1c4-faa96388124f tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:38.289885 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-87af49f4-908f-4718-b1c4-faa96388124f tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:38.437587 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-82e8988e-304d-454f-95b6-baf4f498e72c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:38.438643 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-82e8988e-304d-454f-95b6-baf4f498e72c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:38.447406 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-82e8988e-304d-454f-95b6-baf4f498e72c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:38.448078 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-82e8988e-304d-454f-95b6-baf4f498e72c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:38.448937 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-82e8988e-304d-454f-95b6-baf4f498e72c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:38.449416 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-82e8988e-304d-454f-95b6-baf4f498e72c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:38.514703 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-87af49f4-908f-4718-b1c4-faa96388124f tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:38.523951 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-87af49f4-908f-4718-b1c4-faa96388124f tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1576 microversion: 2.1 time: 0.250354 Apr 15 20:00:38.524684 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 440/965] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:00:38 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1576 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:00:38.602021 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-82e8988e-304d-454f-95b6-baf4f498e72c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 14 microversion: 2.1 time: 0.169428 Apr 15 20:00:38.605917 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 526/966] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:00:38 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 14 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 15 20:00:39.055166 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-258e9421-878b-4fe2-8136-8cc2dbcaadf4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:39.057210 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-258e9421-878b-4fe2-8136-8cc2dbcaadf4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:39.065616 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-258e9421-878b-4fe2-8136-8cc2dbcaadf4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:39.066266 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-258e9421-878b-4fe2-8136-8cc2dbcaadf4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:39.067214 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-258e9421-878b-4fe2-8136-8cc2dbcaadf4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:39.067810 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-258e9421-878b-4fe2-8136-8cc2dbcaadf4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:39.179086 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-258e9421-878b-4fe2-8136-8cc2dbcaadf4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 32368 microversion: 2.20 time: 0.127797 Apr 15 20:00:39.183407 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 441/967] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:39 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 32368 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:00:39.543486 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-37c32b75-5ab5-41af-acd7-9cb8c69ae0e6 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:39.544371 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-37c32b75-5ab5-41af-acd7-9cb8c69ae0e6 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:39.552964 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-37c32b75-5ab5-41af-acd7-9cb8c69ae0e6 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:39.553477 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-37c32b75-5ab5-41af-acd7-9cb8c69ae0e6 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:39.554319 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-37c32b75-5ab5-41af-acd7-9cb8c69ae0e6 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:39.554821 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-37c32b75-5ab5-41af-acd7-9cb8c69ae0e6 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:39.615758 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-8b1be575-97dc-4650-a35d-2440fcdb7cf4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:39.617029 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-8b1be575-97dc-4650-a35d-2440fcdb7cf4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:39.626033 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8b1be575-97dc-4650-a35d-2440fcdb7cf4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:39.626891 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8b1be575-97dc-4650-a35d-2440fcdb7cf4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:39.628005 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8b1be575-97dc-4650-a35d-2440fcdb7cf4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:39.628702 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8b1be575-97dc-4650-a35d-2440fcdb7cf4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:39.756628 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-8b1be575-97dc-4650-a35d-2440fcdb7cf4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 14 microversion: 2.1 time: 0.145982 Apr 15 20:00:39.757355 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 442/968] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:00:39 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 15 20:00:39.777123 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-37c32b75-5ab5-41af-acd7-9cb8c69ae0e6 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:39.786334 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-37c32b75-5ab5-41af-acd7-9cb8c69ae0e6 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1576 microversion: 2.1 time: 0.247548 Apr 15 20:00:39.787141 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 527/969] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:00:39 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1576 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:00:40.192423 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f0ec8b5e-7303-47b1-8d21-1a7cfdb5890f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:40.193501 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f0ec8b5e-7303-47b1-8d21-1a7cfdb5890f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:40.203160 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f0ec8b5e-7303-47b1-8d21-1a7cfdb5890f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:40.203697 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f0ec8b5e-7303-47b1-8d21-1a7cfdb5890f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:40.204547 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f0ec8b5e-7303-47b1-8d21-1a7cfdb5890f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:40.205046 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f0ec8b5e-7303-47b1-8d21-1a7cfdb5890f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:40.328178 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f0ec8b5e-7303-47b1-8d21-1a7cfdb5890f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 33348 microversion: 2.20 time: 0.140120 Apr 15 20:00:40.330395 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 443/970] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:40 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 33348 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:00:40.767757 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-12da4423-516c-4205-b6a2-580bbcdedfeb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:40.768903 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-12da4423-516c-4205-b6a2-580bbcdedfeb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:40.778089 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-12da4423-516c-4205-b6a2-580bbcdedfeb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:40.778680 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-12da4423-516c-4205-b6a2-580bbcdedfeb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:40.779646 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-12da4423-516c-4205-b6a2-580bbcdedfeb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:40.780215 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-12da4423-516c-4205-b6a2-580bbcdedfeb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:40.806427 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-0c083bd1-4e6d-4981-8c81-cf2b6f5650c9 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:40.807410 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-0c083bd1-4e6d-4981-8c81-cf2b6f5650c9 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:40.815611 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0c083bd1-4e6d-4981-8c81-cf2b6f5650c9 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:40.816135 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0c083bd1-4e6d-4981-8c81-cf2b6f5650c9 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:40.817123 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0c083bd1-4e6d-4981-8c81-cf2b6f5650c9 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:40.817632 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0c083bd1-4e6d-4981-8c81-cf2b6f5650c9 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:40.885886 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-12da4423-516c-4205-b6a2-580bbcdedfeb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 14 microversion: 2.1 time: 0.121231 Apr 15 20:00:40.890157 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 528/971] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:00:40 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 15 20:00:41.042594 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-0c083bd1-4e6d-4981-8c81-cf2b6f5650c9 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:41.051934 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-0c083bd1-4e6d-4981-8c81-cf2b6f5650c9 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1563 microversion: 2.1 time: 0.250611 Apr 15 20:00:41.052608 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 444/972] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:00:40 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1563 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 20:00:41.341843 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-65ac1032-b52a-4522-aa26-ea85cc7ff498 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:41.343129 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-65ac1032-b52a-4522-aa26-ea85cc7ff498 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:41.351630 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-65ac1032-b52a-4522-aa26-ea85cc7ff498 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:41.352243 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-65ac1032-b52a-4522-aa26-ea85cc7ff498 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:41.353184 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-65ac1032-b52a-4522-aa26-ea85cc7ff498 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:41.354267 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-65ac1032-b52a-4522-aa26-ea85cc7ff498 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:41.456507 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-65ac1032-b52a-4522-aa26-ea85cc7ff498 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 34602 microversion: 2.20 time: 0.119208 Apr 15 20:00:41.461196 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 529/973] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:41 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 34602 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:00:41.898624 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f2d1ec41-a7d3-4063-807e-88b94878997c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:41.899688 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f2d1ec41-a7d3-4063-807e-88b94878997c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:41.908623 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f2d1ec41-a7d3-4063-807e-88b94878997c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:41.909129 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f2d1ec41-a7d3-4063-807e-88b94878997c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:41.909965 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f2d1ec41-a7d3-4063-807e-88b94878997c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:41.910454 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f2d1ec41-a7d3-4063-807e-88b94878997c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:42.010396 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f2d1ec41-a7d3-4063-807e-88b94878997c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 14 microversion: 2.1 time: 0.115690 Apr 15 20:00:42.013817 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 445/974] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:00:41 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 15 20:00:42.470056 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-db70a99c-7cf0-4008-a738-09c228001af1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:42.471114 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-db70a99c-7cf0-4008-a738-09c228001af1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:42.479758 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-db70a99c-7cf0-4008-a738-09c228001af1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:42.480296 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-db70a99c-7cf0-4008-a738-09c228001af1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:42.481098 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-db70a99c-7cf0-4008-a738-09c228001af1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:42.481599 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-db70a99c-7cf0-4008-a738-09c228001af1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:42.593689 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-db70a99c-7cf0-4008-a738-09c228001af1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 35970 microversion: 2.20 time: 0.128201 Apr 15 20:00:42.594356 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 530/975] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:42 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 35970 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:00:43.021794 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-8682fafe-923c-4648-be9a-125eeaf3ecae tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:43.022969 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-8682fafe-923c-4648-be9a-125eeaf3ecae tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:43.031573 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8682fafe-923c-4648-be9a-125eeaf3ecae tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:43.032088 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8682fafe-923c-4648-be9a-125eeaf3ecae tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:43.032930 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8682fafe-923c-4648-be9a-125eeaf3ecae tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:43.033433 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8682fafe-923c-4648-be9a-125eeaf3ecae tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:43.136436 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-8682fafe-923c-4648-be9a-125eeaf3ecae tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 14 microversion: 2.1 time: 0.119026 Apr 15 20:00:43.137086 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 446/976] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:00:43 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 15 20:00:43.539007 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-e1ea2957-7342-49d6-aa12-289282d5c1a3 req-7211934d-8177-4786-a385-acdabe244a37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c241efcb-ba90-43dd-a6c3-393b77086172", "name": "network-vif-plugged", "status": "completed", "tag": "32a87087-67a6-454d-8830-c295f0d8e889"}]} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:43.541480 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:00:43.541480 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:00:43.553442 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-e1ea2957-7342-49d6-aa12-289282d5c1a3 req-7211934d-8177-4786-a385-acdabe244a37 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:43.553950 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-e1ea2957-7342-49d6-aa12-289282d5c1a3 req-7211934d-8177-4786-a385-acdabe244a37 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:43.571137 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-e1ea2957-7342-49d6-aa12-289282d5c1a3 req-7211934d-8177-4786-a385-acdabe244a37 service nova] Creating event network-vif-plugged:32a87087-67a6-454d-8830-c295f0d8e889 for instance c241efcb-ba90-43dd-a6c3-393b77086172 on hv-cinder-78638 Apr 15 20:00:43.576362 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-e1ea2957-7342-49d6-aa12-289282d5c1a3 req-7211934d-8177-4786-a385-acdabe244a37 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042341 Apr 15 20:00:43.577011 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 531/977] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:00:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:00:43.607808 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-52084c3e-f5af-4e85-8c87-f25fd619e9c7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:43.608957 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-52084c3e-f5af-4e85-8c87-f25fd619e9c7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:43.617484 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-52084c3e-f5af-4e85-8c87-f25fd619e9c7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:43.618619 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-52084c3e-f5af-4e85-8c87-f25fd619e9c7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:43.619935 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-52084c3e-f5af-4e85-8c87-f25fd619e9c7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:43.620478 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-52084c3e-f5af-4e85-8c87-f25fd619e9c7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:43.719670 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-52084c3e-f5af-4e85-8c87-f25fd619e9c7 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 37600 microversion: 2.20 time: 0.117053 Apr 15 20:00:43.720370 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 447/978] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:43 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 37600 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:00:44.148767 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-12d0b1b4-55a4-46ed-b5f4-d57869114fc3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:44.149963 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-12d0b1b4-55a4-46ed-b5f4-d57869114fc3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:44.158064 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-12d0b1b4-55a4-46ed-b5f4-d57869114fc3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:44.158573 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-12d0b1b4-55a4-46ed-b5f4-d57869114fc3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:44.159443 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-12d0b1b4-55a4-46ed-b5f4-d57869114fc3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:44.159966 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-12d0b1b4-55a4-46ed-b5f4-d57869114fc3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:44.263681 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-12d0b1b4-55a4-46ed-b5f4-d57869114fc3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 14 microversion: 2.1 time: 0.119323 Apr 15 20:00:44.264348 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 532/979] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:00:44 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 15 20:00:44.733815 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-fd6265a8-e41a-41fd-9d7e-f7c964d1ed18 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:44.734951 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-fd6265a8-e41a-41fd-9d7e-f7c964d1ed18 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:44.743584 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fd6265a8-e41a-41fd-9d7e-f7c964d1ed18 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:44.744096 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fd6265a8-e41a-41fd-9d7e-f7c964d1ed18 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:44.744929 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fd6265a8-e41a-41fd-9d7e-f7c964d1ed18 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:44.745425 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fd6265a8-e41a-41fd-9d7e-f7c964d1ed18 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:44.849923 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-fd6265a8-e41a-41fd-9d7e-f7c964d1ed18 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 38214 microversion: 2.20 time: 0.121214 Apr 15 20:00:44.850607 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 448/980] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:44 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 38214 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 15 20:00:45.275197 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a8f58a7d-4ae1-4984-a1a3-023b72f95864 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:45.276366 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a8f58a7d-4ae1-4984-a1a3-023b72f95864 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:45.285541 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a8f58a7d-4ae1-4984-a1a3-023b72f95864 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:45.286050 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a8f58a7d-4ae1-4984-a1a3-023b72f95864 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:45.286887 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a8f58a7d-4ae1-4984-a1a3-023b72f95864 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:45.287408 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a8f58a7d-4ae1-4984-a1a3-023b72f95864 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:45.385711 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a8f58a7d-4ae1-4984-a1a3-023b72f95864 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 14 microversion: 2.1 time: 0.114978 Apr 15 20:00:45.386359 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 533/981] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:00:45 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 15 20:00:45.863642 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6d8834fd-5f16-4c39-84ab-99656dd2618f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:45.864835 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6d8834fd-5f16-4c39-84ab-99656dd2618f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:45.873480 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6d8834fd-5f16-4c39-84ab-99656dd2618f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:45.873999 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6d8834fd-5f16-4c39-84ab-99656dd2618f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:45.874832 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6d8834fd-5f16-4c39-84ab-99656dd2618f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:45.875355 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6d8834fd-5f16-4c39-84ab-99656dd2618f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:45.978749 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6d8834fd-5f16-4c39-84ab-99656dd2618f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 38214 microversion: 2.20 time: 0.119616 Apr 15 20:00:45.979373 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 449/982] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:45 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 38214 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:00:46.398457 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-0be4047a-c6cf-4fb9-bc32-6e6e3d18a558 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:46.399649 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-0be4047a-c6cf-4fb9-bc32-6e6e3d18a558 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:46.408388 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0be4047a-c6cf-4fb9-bc32-6e6e3d18a558 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:46.408936 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0be4047a-c6cf-4fb9-bc32-6e6e3d18a558 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:46.409775 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0be4047a-c6cf-4fb9-bc32-6e6e3d18a558 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:46.410268 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0be4047a-c6cf-4fb9-bc32-6e6e3d18a558 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:46.509382 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-0be4047a-c6cf-4fb9-bc32-6e6e3d18a558 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 12498 microversion: 2.1 time: 0.115329 Apr 15 20:00:46.510037 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 534/983] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:00:46 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 12498 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:00:46.992081 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-dbdb826e-a371-4e6d-a97a-533174e05bb4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:46.993260 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-dbdb826e-a371-4e6d-a97a-533174e05bb4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:47.001926 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dbdb826e-a371-4e6d-a97a-533174e05bb4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:47.002438 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dbdb826e-a371-4e6d-a97a-533174e05bb4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:47.003317 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dbdb826e-a371-4e6d-a97a-533174e05bb4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:47.003793 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dbdb826e-a371-4e6d-a97a-533174e05bb4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:47.103164 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-dbdb826e-a371-4e6d-a97a-533174e05bb4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 38214 microversion: 2.20 time: 0.115546 Apr 15 20:00:47.103877 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 450/984] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:46 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 38214 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:00:47.522207 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d2885a44-b963-44dc-949c-f697572f64fc tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:47.523377 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d2885a44-b963-44dc-949c-f697572f64fc tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:47.532581 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d2885a44-b963-44dc-949c-f697572f64fc tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:47.533094 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d2885a44-b963-44dc-949c-f697572f64fc tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:47.533933 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d2885a44-b963-44dc-949c-f697572f64fc tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:47.534430 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d2885a44-b963-44dc-949c-f697572f64fc tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:47.630972 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d2885a44-b963-44dc-949c-f697572f64fc tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 18498 microversion: 2.1 time: 0.113019 Apr 15 20:00:47.632807 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 535/985] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:00:47 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 18498 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:00:48.117279 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-27f2d0e8-5727-49c2-80d7-d19ddd393022 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:48.118354 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-27f2d0e8-5727-49c2-80d7-d19ddd393022 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:48.127594 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-27f2d0e8-5727-49c2-80d7-d19ddd393022 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:48.128098 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-27f2d0e8-5727-49c2-80d7-d19ddd393022 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:48.128919 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-27f2d0e8-5727-49c2-80d7-d19ddd393022 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:48.129404 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-27f2d0e8-5727-49c2-80d7-d19ddd393022 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:48.231639 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-27f2d0e8-5727-49c2-80d7-d19ddd393022 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 38294 microversion: 2.20 time: 0.118929 Apr 15 20:00:48.232622 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 451/986] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:48 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 38294 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:00:48.643925 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d37ac734-9c11-400a-91d1-1beb2f45e171 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:48.645114 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d37ac734-9c11-400a-91d1-1beb2f45e171 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:48.654199 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d37ac734-9c11-400a-91d1-1beb2f45e171 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:48.654709 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d37ac734-9c11-400a-91d1-1beb2f45e171 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:48.655570 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d37ac734-9c11-400a-91d1-1beb2f45e171 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:48.656069 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d37ac734-9c11-400a-91d1-1beb2f45e171 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:48.765496 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d37ac734-9c11-400a-91d1-1beb2f45e171 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 19342 microversion: 2.1 time: 0.126039 Apr 15 20:00:48.766166 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 536/987] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:00:48 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 19342 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:00:49.243997 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-affef2d9-870f-4eca-a2e9-eccecf46f085 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:49.245147 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-affef2d9-870f-4eca-a2e9-eccecf46f085 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:49.253524 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-affef2d9-870f-4eca-a2e9-eccecf46f085 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:49.254035 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-affef2d9-870f-4eca-a2e9-eccecf46f085 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:49.254870 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-affef2d9-870f-4eca-a2e9-eccecf46f085 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:49.255400 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-affef2d9-870f-4eca-a2e9-eccecf46f085 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:49.360192 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-affef2d9-870f-4eca-a2e9-eccecf46f085 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 200 len: 38355 microversion: 2.20 time: 0.120645 Apr 15 20:00:49.360856 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 452/988] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:49 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 38355 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:00:49.372140 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a1083b1c-45dc-47b5-9e76-c142c1faa9e1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:49.372893 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a1083b1c-45dc-47b5-9e76-c142c1faa9e1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:49.381549 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a1083b1c-45dc-47b5-9e76-c142c1faa9e1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:49.382060 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a1083b1c-45dc-47b5-9e76-c142c1faa9e1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:49.382892 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a1083b1c-45dc-47b5-9e76-c142c1faa9e1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:49.383417 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a1083b1c-45dc-47b5-9e76-c142c1faa9e1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:49.445345 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a1083b1c-45dc-47b5-9e76-c142c1faa9e1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/ips" status: 200 len: 152 microversion: 2.20 time: 0.077662 Apr 15 20:00:49.445980 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 537/989] 10.222.0.58 () {60 vars in 1279 bytes} [Thu Apr 15 20:00:49 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/ips => generated 152 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:00:49.778919 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-17dbe417-e224-4688-b6ec-d47f5cdff697 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:49.780091 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-17dbe417-e224-4688-b6ec-d47f5cdff697 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:49.789335 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-17dbe417-e224-4688-b6ec-d47f5cdff697 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:49.789923 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-17dbe417-e224-4688-b6ec-d47f5cdff697 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:49.791057 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-17dbe417-e224-4688-b6ec-d47f5cdff697 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:49.791141 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-17dbe417-e224-4688-b6ec-d47f5cdff697 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:49.907973 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-17dbe417-e224-4688-b6ec-d47f5cdff697 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 21972 microversion: 2.1 time: 0.133843 Apr 15 20:00:49.908735 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 453/990] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:00:49 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 21972 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:00:50.920934 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-2b35dbab-4573-4a45-8ab1-8dab64989369 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:50.921971 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-2b35dbab-4573-4a45-8ab1-8dab64989369 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:50.930352 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2b35dbab-4573-4a45-8ab1-8dab64989369 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:50.930865 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2b35dbab-4573-4a45-8ab1-8dab64989369 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:50.931727 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2b35dbab-4573-4a45-8ab1-8dab64989369 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:50.932221 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2b35dbab-4573-4a45-8ab1-8dab64989369 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:51.034447 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-2b35dbab-4573-4a45-8ab1-8dab64989369 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 23234 microversion: 2.1 time: 0.117953 Apr 15 20:00:51.035149 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 538/991] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:00:50 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 23234 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:00:51.797852 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9918b1d7-a095-46cd-affd-500e11d8b8c9 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:51.798594 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9918b1d7-a095-46cd-affd-500e11d8b8c9 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:51.807482 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9918b1d7-a095-46cd-affd-500e11d8b8c9 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:51.807989 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9918b1d7-a095-46cd-affd-500e11d8b8c9 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:51.808839 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9918b1d7-a095-46cd-affd-500e11d8b8c9 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:51.809332 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9918b1d7-a095-46cd-affd-500e11d8b8c9 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:51.870468 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.objects.instance [None req-9918b1d7-a095-46cd-affd-500e11d8b8c9 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lazy-loading 'flavor' on Instance uuid aac757a2-25b5-4006-abd0-4b3aa0b5ae08 {{(pid=99512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 15 20:00:52.048075 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-efc63b2d-be15-4c6a-b3bd-da354e6ede95 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:52.049313 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-efc63b2d-be15-4c6a-b3bd-da354e6ede95 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:52.058078 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-efc63b2d-be15-4c6a-b3bd-da354e6ede95 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:52.058577 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-efc63b2d-be15-4c6a-b3bd-da354e6ede95 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:52.059467 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-efc63b2d-be15-4c6a-b3bd-da354e6ede95 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:52.060052 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-efc63b2d-be15-4c6a-b3bd-da354e6ede95 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:52.176460 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-efc63b2d-be15-4c6a-b3bd-da354e6ede95 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 24801 microversion: 2.1 time: 0.132683 Apr 15 20:00:52.177393 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 539/992] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:00:52 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 24801 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:00:52.219576 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9918b1d7-a095-46cd-affd-500e11d8b8c9 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 202 len: 0 microversion: 2.20 time: 0.426795 Apr 15 20:00:52.220257 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 454/993] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:00:51 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 15 20:00:52.229343 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ab82eb08-2109-4657-b451-d41cc78e4eec tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:52.230113 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ab82eb08-2109-4657-b451-d41cc78e4eec tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:52.238705 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ab82eb08-2109-4657-b451-d41cc78e4eec tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:52.239214 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ab82eb08-2109-4657-b451-d41cc78e4eec tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:52.240112 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ab82eb08-2109-4657-b451-d41cc78e4eec tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:52.240648 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ab82eb08-2109-4657-b451-d41cc78e4eec tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:52.454372 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ab82eb08-2109-4657-b451-d41cc78e4eec tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:52.463747 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ab82eb08-2109-4657-b451-d41cc78e4eec tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:52.465426 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ab82eb08-2109-4657-b451-d41cc78e4eec tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:52.466644 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ab82eb08-2109-4657-b451-d41cc78e4eec tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1724 microversion: 2.20 time: 0.241774 Apr 15 20:00:52.467259 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 540/994] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:00:52 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 20:00:53.189296 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-928d2893-170c-4511-8fec-b923d3ebf3d9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:53.190420 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-928d2893-170c-4511-8fec-b923d3ebf3d9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:53.199327 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-928d2893-170c-4511-8fec-b923d3ebf3d9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:53.199839 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-928d2893-170c-4511-8fec-b923d3ebf3d9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:53.200680 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-928d2893-170c-4511-8fec-b923d3ebf3d9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:53.201173 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-928d2893-170c-4511-8fec-b923d3ebf3d9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:53.305025 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-928d2893-170c-4511-8fec-b923d3ebf3d9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 26258 microversion: 2.1 time: 0.120580 Apr 15 20:00:53.305780 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 455/995] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:00:53 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 26258 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:00:53.486377 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-46e315a0-2c5a-4a1d-a534-193b31495f03 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:53.487013 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-46e315a0-2c5a-4a1d-a534-193b31495f03 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:53.495593 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-46e315a0-2c5a-4a1d-a534-193b31495f03 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:53.496150 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-46e315a0-2c5a-4a1d-a534-193b31495f03 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:53.496990 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-46e315a0-2c5a-4a1d-a534-193b31495f03 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:53.497489 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-46e315a0-2c5a-4a1d-a534-193b31495f03 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:53.708795 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-46e315a0-2c5a-4a1d-a534-193b31495f03 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:53.718323 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-46e315a0-2c5a-4a1d-a534-193b31495f03 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:53.720032 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-46e315a0-2c5a-4a1d-a534-193b31495f03 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:53.721254 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-46e315a0-2c5a-4a1d-a534-193b31495f03 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1724 microversion: 2.20 time: 0.239091 Apr 15 20:00:53.721860 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 541/996] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:00:53 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 20:00:54.318088 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e9c73125-5ce6-4b00-af52-b26a52a3b2a1 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:54.319419 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e9c73125-5ce6-4b00-af52-b26a52a3b2a1 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:54.327988 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e9c73125-5ce6-4b00-af52-b26a52a3b2a1 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:54.328493 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e9c73125-5ce6-4b00-af52-b26a52a3b2a1 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:54.329327 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e9c73125-5ce6-4b00-af52-b26a52a3b2a1 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:54.329826 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e9c73125-5ce6-4b00-af52-b26a52a3b2a1 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:54.439966 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e9c73125-5ce6-4b00-af52-b26a52a3b2a1 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 27195 microversion: 2.1 time: 0.126320 Apr 15 20:00:54.440890 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 456/997] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:00:54 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 27195 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:00:54.741130 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-86270c64-e0d9-4d92-9722-9a1cdddc91db tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:54.741804 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-86270c64-e0d9-4d92-9722-9a1cdddc91db tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:54.749756 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-86270c64-e0d9-4d92-9722-9a1cdddc91db tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:54.750269 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-86270c64-e0d9-4d92-9722-9a1cdddc91db tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:54.751100 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-86270c64-e0d9-4d92-9722-9a1cdddc91db tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:54.751623 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-86270c64-e0d9-4d92-9722-9a1cdddc91db tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:54.966284 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-86270c64-e0d9-4d92-9722-9a1cdddc91db tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:54.975555 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-86270c64-e0d9-4d92-9722-9a1cdddc91db tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:54.977221 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-86270c64-e0d9-4d92-9722-9a1cdddc91db tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:54.978429 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-86270c64-e0d9-4d92-9722-9a1cdddc91db tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1724 microversion: 2.20 time: 0.241487 Apr 15 20:00:54.979044 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 542/998] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:00:54 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 20:00:55.453437 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7dd8ce32-ece8-4ae1-9a60-e76d9f2ea8a2 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:55.454580 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7dd8ce32-ece8-4ae1-9a60-e76d9f2ea8a2 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:55.463091 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7dd8ce32-ece8-4ae1-9a60-e76d9f2ea8a2 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:55.463629 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7dd8ce32-ece8-4ae1-9a60-e76d9f2ea8a2 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:55.464454 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7dd8ce32-ece8-4ae1-9a60-e76d9f2ea8a2 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:55.464942 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7dd8ce32-ece8-4ae1-9a60-e76d9f2ea8a2 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:55.573657 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7dd8ce32-ece8-4ae1-9a60-e76d9f2ea8a2 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 27777 microversion: 2.1 time: 0.125158 Apr 15 20:00:55.574318 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 457/999] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:00:55 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 27777 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:00:55.997819 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-79ff6419-1212-4619-899f-280de31eb6ce tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:55.998427 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-79ff6419-1212-4619-899f-280de31eb6ce tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:56.006763 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-79ff6419-1212-4619-899f-280de31eb6ce tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:56.007302 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-79ff6419-1212-4619-899f-280de31eb6ce tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:56.008126 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-79ff6419-1212-4619-899f-280de31eb6ce tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:56.008615 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-79ff6419-1212-4619-899f-280de31eb6ce tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:56.357416 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-79ff6419-1212-4619-899f-280de31eb6ce tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:56.366800 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-79ff6419-1212-4619-899f-280de31eb6ce tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:56.368475 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-79ff6419-1212-4619-899f-280de31eb6ce tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:56.369681 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-79ff6419-1212-4619-899f-280de31eb6ce tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1724 microversion: 2.20 time: 0.376014 Apr 15 20:00:56.370285 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 543/1000] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:00:55 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1724 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 20:00:56.586504 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-65b7add7-0dd5-4d26-81bb-c06aa28bae2d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:56.587610 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-65b7add7-0dd5-4d26-81bb-c06aa28bae2d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:56.596704 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-65b7add7-0dd5-4d26-81bb-c06aa28bae2d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:56.597209 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-65b7add7-0dd5-4d26-81bb-c06aa28bae2d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:56.598031 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-65b7add7-0dd5-4d26-81bb-c06aa28bae2d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:56.598516 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-65b7add7-0dd5-4d26-81bb-c06aa28bae2d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:56.706654 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-65b7add7-0dd5-4d26-81bb-c06aa28bae2d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 28193 microversion: 2.1 time: 0.124446 Apr 15 20:00:56.707690 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 458/1001] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:00:56 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 28193 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:00:57.389086 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c40fe409-d1a5-4656-87f5-a9c1d3905c3d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:57.389753 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c40fe409-d1a5-4656-87f5-a9c1d3905c3d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:57.397568 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c40fe409-d1a5-4656-87f5-a9c1d3905c3d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:57.398081 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c40fe409-d1a5-4656-87f5-a9c1d3905c3d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:57.398915 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c40fe409-d1a5-4656-87f5-a9c1d3905c3d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:57.399436 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c40fe409-d1a5-4656-87f5-a9c1d3905c3d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:57.608519 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c40fe409-d1a5-4656-87f5-a9c1d3905c3d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:57.617863 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c40fe409-d1a5-4656-87f5-a9c1d3905c3d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:57.619561 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c40fe409-d1a5-4656-87f5-a9c1d3905c3d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:57.620783 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c40fe409-d1a5-4656-87f5-a9c1d3905c3d tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1724 microversion: 2.20 time: 0.236228 Apr 15 20:00:57.621392 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 544/1002] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:00:57 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1724 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 20:00:57.719085 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-cf730a6e-132f-4935-a1f5-ecd08e988616 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:57.720248 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-cf730a6e-132f-4935-a1f5-ecd08e988616 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:57.728847 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cf730a6e-132f-4935-a1f5-ecd08e988616 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:57.729351 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cf730a6e-132f-4935-a1f5-ecd08e988616 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:57.730173 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cf730a6e-132f-4935-a1f5-ecd08e988616 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:57.730663 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cf730a6e-132f-4935-a1f5-ecd08e988616 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:57.829196 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-cf730a6e-132f-4935-a1f5-ecd08e988616 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 28195 microversion: 2.1 time: 0.114505 Apr 15 20:00:57.829890 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 459/1003] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:00:57 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 28195 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:00:58.641529 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-014e7621-c30c-4055-be79-a12bf5358d22 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:58.642217 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-014e7621-c30c-4055-be79-a12bf5358d22 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:58.650029 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-014e7621-c30c-4055-be79-a12bf5358d22 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:58.650540 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-014e7621-c30c-4055-be79-a12bf5358d22 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:58.651404 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-014e7621-c30c-4055-be79-a12bf5358d22 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:58.651903 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-014e7621-c30c-4055-be79-a12bf5358d22 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:58.842763 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-539c88f5-1457-4dc6-82cd-b064a593a35b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:58.843960 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-539c88f5-1457-4dc6-82cd-b064a593a35b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:58.852396 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-539c88f5-1457-4dc6-82cd-b064a593a35b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:58.852900 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-539c88f5-1457-4dc6-82cd-b064a593a35b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:58.853738 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-539c88f5-1457-4dc6-82cd-b064a593a35b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:58.854229 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-539c88f5-1457-4dc6-82cd-b064a593a35b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:58.866991 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-014e7621-c30c-4055-be79-a12bf5358d22 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:58.876579 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-014e7621-c30c-4055-be79-a12bf5358d22 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:58.878260 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-014e7621-c30c-4055-be79-a12bf5358d22 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:00:58.879517 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-014e7621-c30c-4055-be79-a12bf5358d22 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1724 microversion: 2.20 time: 0.242865 Apr 15 20:00:58.880151 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 545/1004] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:00:58 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 20:00:58.961337 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-539c88f5-1457-4dc6-82cd-b064a593a35b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 28195 microversion: 2.1 time: 0.123572 Apr 15 20:00:58.961944 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 460/1005] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:00:58 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 28195 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 15 20:00:59.899482 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-5dcad16e-2d54-4324-8e1a-156c20716dbc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:00:59.900139 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-5dcad16e-2d54-4324-8e1a-156c20716dbc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:59.907904 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5dcad16e-2d54-4324-8e1a-156c20716dbc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:59.908406 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5dcad16e-2d54-4324-8e1a-156c20716dbc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:59.909235 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5dcad16e-2d54-4324-8e1a-156c20716dbc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:59.909721 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5dcad16e-2d54-4324-8e1a-156c20716dbc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:59.974140 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-91ad70c5-3b86-4ec2-b017-fbac5dc65a46 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:00:59.975196 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-91ad70c5-3b86-4ec2-b017-fbac5dc65a46 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:00:59.983895 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-91ad70c5-3b86-4ec2-b017-fbac5dc65a46 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:59.984414 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-91ad70c5-3b86-4ec2-b017-fbac5dc65a46 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:00:59.985265 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-91ad70c5-3b86-4ec2-b017-fbac5dc65a46 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:00:59.985767 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-91ad70c5-3b86-4ec2-b017-fbac5dc65a46 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:00.090095 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-91ad70c5-3b86-4ec2-b017-fbac5dc65a46 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 28195 microversion: 2.1 time: 0.120362 Apr 15 20:01:00.090836 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 461/1006] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:00:59 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 28195 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 15 20:01:00.119133 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-5dcad16e-2d54-4324-8e1a-156c20716dbc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:00.129260 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-5dcad16e-2d54-4324-8e1a-156c20716dbc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:00.130924 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-5dcad16e-2d54-4324-8e1a-156c20716dbc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:00.132191 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-5dcad16e-2d54-4324-8e1a-156c20716dbc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1724 microversion: 2.20 time: 0.236808 Apr 15 20:01:00.132784 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 546/1007] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:00:59 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 20:01:01.103505 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ca62e0ba-1498-4dd1-9da0-1ca0ad27997f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:01.104691 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ca62e0ba-1498-4dd1-9da0-1ca0ad27997f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:01.113745 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ca62e0ba-1498-4dd1-9da0-1ca0ad27997f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:01.114254 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ca62e0ba-1498-4dd1-9da0-1ca0ad27997f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:01.115108 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ca62e0ba-1498-4dd1-9da0-1ca0ad27997f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:01.115743 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ca62e0ba-1498-4dd1-9da0-1ca0ad27997f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:01.151541 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-541cca24-9e6d-43ff-93d8-7fcd402ba3c5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:01.152215 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-541cca24-9e6d-43ff-93d8-7fcd402ba3c5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:01.160518 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-541cca24-9e6d-43ff-93d8-7fcd402ba3c5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:01.161452 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-541cca24-9e6d-43ff-93d8-7fcd402ba3c5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:01.161848 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-541cca24-9e6d-43ff-93d8-7fcd402ba3c5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:01.162338 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-541cca24-9e6d-43ff-93d8-7fcd402ba3c5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:01.217985 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ca62e0ba-1498-4dd1-9da0-1ca0ad27997f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 28195 microversion: 2.1 time: 0.119095 Apr 15 20:01:01.220427 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 462/1008] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:01:01 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 28195 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:01:01.383905 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-541cca24-9e6d-43ff-93d8-7fcd402ba3c5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:01.394152 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-541cca24-9e6d-43ff-93d8-7fcd402ba3c5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:01.395856 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-541cca24-9e6d-43ff-93d8-7fcd402ba3c5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:01.397068 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-541cca24-9e6d-43ff-93d8-7fcd402ba3c5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1724 microversion: 2.20 time: 0.249687 Apr 15 20:01:01.397681 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 547/1009] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:01 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 20:01:02.231753 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-09403be7-19bc-45d2-a0d5-e825d383fc0f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:02.232849 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-09403be7-19bc-45d2-a0d5-e825d383fc0f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:02.241433 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-09403be7-19bc-45d2-a0d5-e825d383fc0f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:02.241935 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-09403be7-19bc-45d2-a0d5-e825d383fc0f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:02.242761 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-09403be7-19bc-45d2-a0d5-e825d383fc0f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:02.243251 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-09403be7-19bc-45d2-a0d5-e825d383fc0f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:02.342080 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-09403be7-19bc-45d2-a0d5-e825d383fc0f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 28195 microversion: 2.1 time: 0.115348 Apr 15 20:01:02.342752 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 463/1010] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:01:02 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 28195 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 15 20:01:02.416646 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-3bb6fd33-695d-4f3f-b5d9-ddf0edb9d424 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:02.417321 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-3bb6fd33-695d-4f3f-b5d9-ddf0edb9d424 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:02.425157 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3bb6fd33-695d-4f3f-b5d9-ddf0edb9d424 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:02.425667 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3bb6fd33-695d-4f3f-b5d9-ddf0edb9d424 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:02.426503 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3bb6fd33-695d-4f3f-b5d9-ddf0edb9d424 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:02.426993 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3bb6fd33-695d-4f3f-b5d9-ddf0edb9d424 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:02.639379 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3bb6fd33-695d-4f3f-b5d9-ddf0edb9d424 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:02.649107 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3bb6fd33-695d-4f3f-b5d9-ddf0edb9d424 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:02.650830 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3bb6fd33-695d-4f3f-b5d9-ddf0edb9d424 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:02.652087 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-3bb6fd33-695d-4f3f-b5d9-ddf0edb9d424 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1724 microversion: 2.20 time: 0.239769 Apr 15 20:01:02.652704 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 548/1011] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:02 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 20:01:03.355044 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-8362f64d-dc50-4545-af04-b68b4ddaa637 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:03.356684 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-8362f64d-dc50-4545-af04-b68b4ddaa637 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:03.365189 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8362f64d-dc50-4545-af04-b68b4ddaa637 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:03.365688 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8362f64d-dc50-4545-af04-b68b4ddaa637 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:03.366503 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8362f64d-dc50-4545-af04-b68b4ddaa637 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:03.366989 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8362f64d-dc50-4545-af04-b68b4ddaa637 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:03.469800 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-8362f64d-dc50-4545-af04-b68b4ddaa637 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 28195 microversion: 2.1 time: 0.119123 Apr 15 20:01:03.470478 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 464/1012] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:01:03 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 28195 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:01:03.672607 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-09aaccdc-5911-4c57-9541-915bcdd45815 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:03.673208 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-09aaccdc-5911-4c57-9541-915bcdd45815 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:03.681078 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-09aaccdc-5911-4c57-9541-915bcdd45815 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:03.681583 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-09aaccdc-5911-4c57-9541-915bcdd45815 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:03.682419 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-09aaccdc-5911-4c57-9541-915bcdd45815 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:03.682908 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-09aaccdc-5911-4c57-9541-915bcdd45815 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:03.893014 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-09aaccdc-5911-4c57-9541-915bcdd45815 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:03.902628 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-09aaccdc-5911-4c57-9541-915bcdd45815 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:03.904970 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-09aaccdc-5911-4c57-9541-915bcdd45815 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:03.906185 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-09aaccdc-5911-4c57-9541-915bcdd45815 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1745 microversion: 2.20 time: 0.238356 Apr 15 20:01:03.906795 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 549/1013] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:03 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1745 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 20:01:04.482353 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-cc5e3999-cd27-4028-b202-c9aea0a8828d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:04.483548 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-cc5e3999-cd27-4028-b202-c9aea0a8828d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:04.492227 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cc5e3999-cd27-4028-b202-c9aea0a8828d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:04.492742 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cc5e3999-cd27-4028-b202-c9aea0a8828d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:04.493577 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cc5e3999-cd27-4028-b202-c9aea0a8828d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:04.494074 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cc5e3999-cd27-4028-b202-c9aea0a8828d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:04.594737 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-cc5e3999-cd27-4028-b202-c9aea0a8828d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 28195 microversion: 2.1 time: 0.117359 Apr 15 20:01:04.595678 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 465/1014] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:01:04 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 28195 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:01:04.926274 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-82b78de3-5856-46c1-bc97-c86daca1ed0c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:04.926974 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-82b78de3-5856-46c1-bc97-c86daca1ed0c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:04.935234 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-82b78de3-5856-46c1-bc97-c86daca1ed0c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:04.935786 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-82b78de3-5856-46c1-bc97-c86daca1ed0c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:04.936608 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-82b78de3-5856-46c1-bc97-c86daca1ed0c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:04.937091 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-82b78de3-5856-46c1-bc97-c86daca1ed0c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:05.147714 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-82b78de3-5856-46c1-bc97-c86daca1ed0c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:05.156986 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-82b78de3-5856-46c1-bc97-c86daca1ed0c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:05.158645 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-82b78de3-5856-46c1-bc97-c86daca1ed0c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:05.159880 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-82b78de3-5856-46c1-bc97-c86daca1ed0c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1745 microversion: 2.20 time: 0.237676 Apr 15 20:01:05.160474 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 550/1015] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:04 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1745 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 20:01:05.607791 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-cd1c5266-be5e-4fca-81e0-6bb4ff1294bc tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:05.609032 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-cd1c5266-be5e-4fca-81e0-6bb4ff1294bc tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:05.617707 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cd1c5266-be5e-4fca-81e0-6bb4ff1294bc tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:05.618222 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cd1c5266-be5e-4fca-81e0-6bb4ff1294bc tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:05.619063 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cd1c5266-be5e-4fca-81e0-6bb4ff1294bc tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:05.619593 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cd1c5266-be5e-4fca-81e0-6bb4ff1294bc tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:05.744574 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-cd1c5266-be5e-4fca-81e0-6bb4ff1294bc tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 28195 microversion: 2.1 time: 0.141656 Apr 15 20:01:05.748676 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 466/1016] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:01:05 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 28195 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:01:06.179259 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d4eea1a6-05d6-4c93-9d30-dff112fa07b8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:06.179956 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d4eea1a6-05d6-4c93-9d30-dff112fa07b8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:06.187861 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d4eea1a6-05d6-4c93-9d30-dff112fa07b8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:06.188372 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d4eea1a6-05d6-4c93-9d30-dff112fa07b8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:06.189205 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d4eea1a6-05d6-4c93-9d30-dff112fa07b8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:06.189697 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d4eea1a6-05d6-4c93-9d30-dff112fa07b8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:06.401547 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d4eea1a6-05d6-4c93-9d30-dff112fa07b8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:06.411503 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d4eea1a6-05d6-4c93-9d30-dff112fa07b8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:06.413441 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d4eea1a6-05d6-4c93-9d30-dff112fa07b8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:06.414654 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d4eea1a6-05d6-4c93-9d30-dff112fa07b8 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1745 microversion: 2.20 time: 0.239614 Apr 15 20:01:06.415268 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 551/1017] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:06 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1745 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 20:01:06.756631 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-5a6588a4-16df-4ac0-8420-95dafcd127da tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:06.757792 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-5a6588a4-16df-4ac0-8420-95dafcd127da tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:06.767010 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5a6588a4-16df-4ac0-8420-95dafcd127da tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:06.767549 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5a6588a4-16df-4ac0-8420-95dafcd127da tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:06.768377 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5a6588a4-16df-4ac0-8420-95dafcd127da tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:06.768868 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5a6588a4-16df-4ac0-8420-95dafcd127da tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:06.865457 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-5a6588a4-16df-4ac0-8420-95dafcd127da tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 28195 microversion: 2.1 time: 0.113106 Apr 15 20:01:06.866502 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 467/1018] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:01:06 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 28195 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:01:07.434139 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f0bcf5e6-1773-4785-973a-a4d067c73357 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:07.434918 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f0bcf5e6-1773-4785-973a-a4d067c73357 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:07.442714 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f0bcf5e6-1773-4785-973a-a4d067c73357 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:07.443216 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f0bcf5e6-1773-4785-973a-a4d067c73357 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:07.444126 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f0bcf5e6-1773-4785-973a-a4d067c73357 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:07.444612 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f0bcf5e6-1773-4785-973a-a4d067c73357 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:07.636749 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-a6f1a406-113e-4177-a815-0ff5d7d6d6df req-b1c3b96a-5467-410f-b0c8-d740697cf877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aac757a2-25b5-4006-abd0-4b3aa0b5ae08", "name": "network-vif-plugged", "status": "completed", "tag": "094b251a-1524-4ff8-b586-45456b2a7026"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:07.639332 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:01:07.639332 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:01:07.649598 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-a6f1a406-113e-4177-a815-0ff5d7d6d6df req-b1c3b96a-5467-410f-b0c8-d740697cf877 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:07.650097 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-a6f1a406-113e-4177-a815-0ff5d7d6d6df req-b1c3b96a-5467-410f-b0c8-d740697cf877 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:07.664270 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f0bcf5e6-1773-4785-973a-a4d067c73357 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:07.668938 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-a6f1a406-113e-4177-a815-0ff5d7d6d6df req-b1c3b96a-5467-410f-b0c8-d740697cf877 service nova] Creating event network-vif-plugged:094b251a-1524-4ff8-b586-45456b2a7026 for instance aac757a2-25b5-4006-abd0-4b3aa0b5ae08 on hv-cinder-78638 Apr 15 20:01:07.674362 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-a6f1a406-113e-4177-a815-0ff5d7d6d6df req-b1c3b96a-5467-410f-b0c8-d740697cf877 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041966 Apr 15 20:01:07.675254 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 468/1019] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:01:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 15 20:01:07.684474 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f0bcf5e6-1773-4785-973a-a4d067c73357 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:07.686166 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f0bcf5e6-1773-4785-973a-a4d067c73357 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:07.687623 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f0bcf5e6-1773-4785-973a-a4d067c73357 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1745 microversion: 2.20 time: 0.257523 Apr 15 20:01:07.688792 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 552/1020] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:07 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1745 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 20:01:07.877797 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-05d09d64-a90c-447d-b21b-8a1b9f8b41ba tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:07.878932 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-05d09d64-a90c-447d-b21b-8a1b9f8b41ba tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:07.886913 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-05d09d64-a90c-447d-b21b-8a1b9f8b41ba tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:07.887951 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-05d09d64-a90c-447d-b21b-8a1b9f8b41ba tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:07.888770 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-05d09d64-a90c-447d-b21b-8a1b9f8b41ba tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:07.889257 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-05d09d64-a90c-447d-b21b-8a1b9f8b41ba tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:07.986362 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-05d09d64-a90c-447d-b21b-8a1b9f8b41ba tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 28195 microversion: 2.1 time: 0.112846 Apr 15 20:01:07.986971 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 469/1021] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:01:07 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 28195 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:01:08.707350 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-5ca686b5-e5ac-4bff-97ff-0dff2acd37f6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:08.708065 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-5ca686b5-e5ac-4bff-97ff-0dff2acd37f6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:08.717235 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5ca686b5-e5ac-4bff-97ff-0dff2acd37f6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:08.717740 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5ca686b5-e5ac-4bff-97ff-0dff2acd37f6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:08.718579 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5ca686b5-e5ac-4bff-97ff-0dff2acd37f6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:08.719069 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5ca686b5-e5ac-4bff-97ff-0dff2acd37f6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:08.933322 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-5ca686b5-e5ac-4bff-97ff-0dff2acd37f6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:08.942702 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-5ca686b5-e5ac-4bff-97ff-0dff2acd37f6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:08.944448 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-5ca686b5-e5ac-4bff-97ff-0dff2acd37f6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:08.945674 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-5ca686b5-e5ac-4bff-97ff-0dff2acd37f6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1745 microversion: 2.20 time: 0.242675 Apr 15 20:01:08.946280 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 553/1022] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:08 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1745 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 20:01:08.999072 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d033e83d-9c68-4d15-bbb9-2d640f308419 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:09.000227 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d033e83d-9c68-4d15-bbb9-2d640f308419 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:09.008792 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d033e83d-9c68-4d15-bbb9-2d640f308419 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:09.009300 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d033e83d-9c68-4d15-bbb9-2d640f308419 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:09.010130 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d033e83d-9c68-4d15-bbb9-2d640f308419 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:09.010623 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d033e83d-9c68-4d15-bbb9-2d640f308419 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:09.109069 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d033e83d-9c68-4d15-bbb9-2d640f308419 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 28195 microversion: 2.1 time: 0.114422 Apr 15 20:01:09.109876 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 470/1023] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:01:08 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 28195 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:01:09.964534 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-58ad1b55-1a95-494d-bbd8-23ba3122a580 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:09.965253 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-58ad1b55-1a95-494d-bbd8-23ba3122a580 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:09.972993 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-58ad1b55-1a95-494d-bbd8-23ba3122a580 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:09.973505 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-58ad1b55-1a95-494d-bbd8-23ba3122a580 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:09.974382 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-58ad1b55-1a95-494d-bbd8-23ba3122a580 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:09.974881 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-58ad1b55-1a95-494d-bbd8-23ba3122a580 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:10.122743 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b2e64631-2f2e-48dc-8a58-f3fec222d9b8 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:10.124388 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b2e64631-2f2e-48dc-8a58-f3fec222d9b8 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:10.133223 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b2e64631-2f2e-48dc-8a58-f3fec222d9b8 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:10.134066 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b2e64631-2f2e-48dc-8a58-f3fec222d9b8 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:10.135004 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b2e64631-2f2e-48dc-8a58-f3fec222d9b8 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:10.135625 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b2e64631-2f2e-48dc-8a58-f3fec222d9b8 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:10.204611 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-58ad1b55-1a95-494d-bbd8-23ba3122a580 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:10.218626 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-58ad1b55-1a95-494d-bbd8-23ba3122a580 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:10.220665 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-58ad1b55-1a95-494d-bbd8-23ba3122a580 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:10.222334 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-58ad1b55-1a95-494d-bbd8-23ba3122a580 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1740 microversion: 2.20 time: 0.261645 Apr 15 20:01:10.223170 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 554/1024] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:09 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1740 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 20:01:10.373152 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b2e64631-2f2e-48dc-8a58-f3fec222d9b8 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 28195 microversion: 2.1 time: 0.255297 Apr 15 20:01:10.373848 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 471/1025] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:01:10 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 28195 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 15 20:01:11.242226 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-df558533-0477-4b69-87a0-e0f35a24a134 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:11.242979 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-df558533-0477-4b69-87a0-e0f35a24a134 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:11.252239 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-df558533-0477-4b69-87a0-e0f35a24a134 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:11.252837 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-df558533-0477-4b69-87a0-e0f35a24a134 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:11.253759 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-df558533-0477-4b69-87a0-e0f35a24a134 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:11.254323 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-df558533-0477-4b69-87a0-e0f35a24a134 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:11.387310 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-afbd282b-57a0-4358-a851-33b7a7bc760d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:11.389029 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-afbd282b-57a0-4358-a851-33b7a7bc760d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:11.398206 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-afbd282b-57a0-4358-a851-33b7a7bc760d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:11.399056 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-afbd282b-57a0-4358-a851-33b7a7bc760d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:11.400148 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-afbd282b-57a0-4358-a851-33b7a7bc760d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:11.400849 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-afbd282b-57a0-4358-a851-33b7a7bc760d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:11.494079 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-df558533-0477-4b69-87a0-e0f35a24a134 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:11.507465 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-df558533-0477-4b69-87a0-e0f35a24a134 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:11.509223 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-df558533-0477-4b69-87a0-e0f35a24a134 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:11.510392 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-df558533-0477-4b69-87a0-e0f35a24a134 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1740 microversion: 2.20 time: 0.272245 Apr 15 20:01:11.511014 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 555/1026] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:11 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1740 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 20:01:11.526574 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-afbd282b-57a0-4358-a851-33b7a7bc760d tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 28195 microversion: 2.1 time: 0.143691 Apr 15 20:01:11.527302 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 472/1027] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:01:11 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 28195 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:01:12.530123 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-58f36484-a9e1-472b-b1a3-b4e519954502 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:12.530788 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-58f36484-a9e1-472b-b1a3-b4e519954502 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:12.539170 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-29e292f7-17d6-4a5e-b48c-b363b14d8759 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:12.540605 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-29e292f7-17d6-4a5e-b48c-b363b14d8759 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:12.553775 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-58f36484-a9e1-472b-b1a3-b4e519954502 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:12.554286 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-58f36484-a9e1-472b-b1a3-b4e519954502 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:12.555139 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-58f36484-a9e1-472b-b1a3-b4e519954502 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:12.555661 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-58f36484-a9e1-472b-b1a3-b4e519954502 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:12.561200 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-29e292f7-17d6-4a5e-b48c-b363b14d8759 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:12.561703 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-29e292f7-17d6-4a5e-b48c-b363b14d8759 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:12.562550 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-29e292f7-17d6-4a5e-b48c-b363b14d8759 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:12.563034 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-29e292f7-17d6-4a5e-b48c-b363b14d8759 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:12.695537 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-29e292f7-17d6-4a5e-b48c-b363b14d8759 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 28485 microversion: 2.1 time: 0.160745 Apr 15 20:01:12.696252 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 473/1028] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:01:12 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 28485 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:01:12.821789 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-58f36484-a9e1-472b-b1a3-b4e519954502 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:12.831812 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-58f36484-a9e1-472b-b1a3-b4e519954502 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:12.833613 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-58f36484-a9e1-472b-b1a3-b4e519954502 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:12.834845 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-58f36484-a9e1-472b-b1a3-b4e519954502 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1740 microversion: 2.20 time: 0.308951 Apr 15 20:01:12.835479 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 556/1029] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:12 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1740 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 20:01:13.708400 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-baa8b30e-523c-4829-8249-8471d7cde4a2 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:13.710435 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-baa8b30e-523c-4829-8249-8471d7cde4a2 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:13.721154 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-baa8b30e-523c-4829-8249-8471d7cde4a2 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:13.721900 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-baa8b30e-523c-4829-8249-8471d7cde4a2 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:13.722884 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-baa8b30e-523c-4829-8249-8471d7cde4a2 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:13.723592 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-baa8b30e-523c-4829-8249-8471d7cde4a2 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:13.836204 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-baa8b30e-523c-4829-8249-8471d7cde4a2 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 28485 microversion: 2.1 time: 0.132244 Apr 15 20:01:13.837785 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 474/1030] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:01:13 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 28485 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 15 20:01:13.853962 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-4a311e67-133a-42ad-9998-d38e2e55b9c4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:13.854632 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-4a311e67-133a-42ad-9998-d38e2e55b9c4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:13.862723 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4a311e67-133a-42ad-9998-d38e2e55b9c4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:13.863517 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4a311e67-133a-42ad-9998-d38e2e55b9c4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:13.864621 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4a311e67-133a-42ad-9998-d38e2e55b9c4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:13.865199 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4a311e67-133a-42ad-9998-d38e2e55b9c4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:14.092129 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-4a311e67-133a-42ad-9998-d38e2e55b9c4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:14.104072 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-4a311e67-133a-42ad-9998-d38e2e55b9c4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:14.106396 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-4a311e67-133a-42ad-9998-d38e2e55b9c4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:14.107674 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-4a311e67-133a-42ad-9998-d38e2e55b9c4 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1740 microversion: 2.20 time: 0.258014 Apr 15 20:01:14.108633 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 557/1031] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:13 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1740 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 20:01:14.850693 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-95efb429-d86f-443f-ba0a-17729f4cc209 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:14.852019 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-95efb429-d86f-443f-ba0a-17729f4cc209 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:14.861798 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-95efb429-d86f-443f-ba0a-17729f4cc209 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:14.862311 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-95efb429-d86f-443f-ba0a-17729f4cc209 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:14.863144 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-95efb429-d86f-443f-ba0a-17729f4cc209 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:14.863662 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-95efb429-d86f-443f-ba0a-17729f4cc209 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:14.974558 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-95efb429-d86f-443f-ba0a-17729f4cc209 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 28653 microversion: 2.1 time: 0.127955 Apr 15 20:01:14.975350 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 475/1032] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:01:14 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 28653 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:01:15.126651 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b9b0d22b-afae-450e-8b82-ed8c769b8992 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:15.127328 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b9b0d22b-afae-450e-8b82-ed8c769b8992 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:15.136528 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b9b0d22b-afae-450e-8b82-ed8c769b8992 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:15.137693 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b9b0d22b-afae-450e-8b82-ed8c769b8992 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:15.138541 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b9b0d22b-afae-450e-8b82-ed8c769b8992 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:15.139033 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b9b0d22b-afae-450e-8b82-ed8c769b8992 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:15.362900 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b9b0d22b-afae-450e-8b82-ed8c769b8992 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:15.373747 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b9b0d22b-afae-450e-8b82-ed8c769b8992 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:15.375768 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b9b0d22b-afae-450e-8b82-ed8c769b8992 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:15.377356 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b9b0d22b-afae-450e-8b82-ed8c769b8992 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1740 microversion: 2.20 time: 0.254833 Apr 15 20:01:15.377979 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 558/1033] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:15 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1740 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 20:01:15.987715 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-3cb69265-5cb5-477d-bfdc-9457afe93ac0 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:15.988912 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-3cb69265-5cb5-477d-bfdc-9457afe93ac0 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:15.997661 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3cb69265-5cb5-477d-bfdc-9457afe93ac0 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:15.998498 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3cb69265-5cb5-477d-bfdc-9457afe93ac0 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:15.998985 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3cb69265-5cb5-477d-bfdc-9457afe93ac0 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:15.999526 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3cb69265-5cb5-477d-bfdc-9457afe93ac0 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:16.122164 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-3cb69265-5cb5-477d-bfdc-9457afe93ac0 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 28653 microversion: 2.1 time: 0.138891 Apr 15 20:01:16.123072 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 476/1034] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:01:15 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 28653 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:01:16.397018 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e2ad9ba5-bf64-4ea6-b0ef-01b1cb1cf395 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:16.397691 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e2ad9ba5-bf64-4ea6-b0ef-01b1cb1cf395 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:16.405972 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e2ad9ba5-bf64-4ea6-b0ef-01b1cb1cf395 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:16.406905 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e2ad9ba5-bf64-4ea6-b0ef-01b1cb1cf395 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:16.407778 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e2ad9ba5-bf64-4ea6-b0ef-01b1cb1cf395 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:16.408277 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e2ad9ba5-bf64-4ea6-b0ef-01b1cb1cf395 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:16.630921 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-e2ad9ba5-bf64-4ea6-b0ef-01b1cb1cf395 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:16.647588 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-e2ad9ba5-bf64-4ea6-b0ef-01b1cb1cf395 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:16.649187 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-e2ad9ba5-bf64-4ea6-b0ef-01b1cb1cf395 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:16.650426 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e2ad9ba5-bf64-4ea6-b0ef-01b1cb1cf395 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1740 microversion: 2.20 time: 0.257748 Apr 15 20:01:16.651043 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 559/1035] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:16 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1740 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 20:01:17.135232 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-51b3fca5-81dd-4499-82df-fa148c9d9467 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:17.136486 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-51b3fca5-81dd-4499-82df-fa148c9d9467 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:17.147285 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-51b3fca5-81dd-4499-82df-fa148c9d9467 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:17.147921 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-51b3fca5-81dd-4499-82df-fa148c9d9467 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:17.149432 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-51b3fca5-81dd-4499-82df-fa148c9d9467 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:17.150274 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-51b3fca5-81dd-4499-82df-fa148c9d9467 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:17.259664 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-51b3fca5-81dd-4499-82df-fa148c9d9467 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 28653 microversion: 2.1 time: 0.128625 Apr 15 20:01:17.260598 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 477/1036] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:01:17 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 28653 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:01:17.669678 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-106379f9-d761-41df-ba69-cb8fadf63d6e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:17.670581 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-106379f9-d761-41df-ba69-cb8fadf63d6e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:17.681846 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-106379f9-d761-41df-ba69-cb8fadf63d6e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:17.682458 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-106379f9-d761-41df-ba69-cb8fadf63d6e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:17.683443 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-106379f9-d761-41df-ba69-cb8fadf63d6e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:17.684539 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-106379f9-d761-41df-ba69-cb8fadf63d6e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:17.927017 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-106379f9-d761-41df-ba69-cb8fadf63d6e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:17.938319 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-106379f9-d761-41df-ba69-cb8fadf63d6e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:17.940818 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-106379f9-d761-41df-ba69-cb8fadf63d6e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:17.943162 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-106379f9-d761-41df-ba69-cb8fadf63d6e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1740 microversion: 2.20 time: 0.277999 Apr 15 20:01:17.955921 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 560/1037] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:17 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1740 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 20:01:18.272851 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6da77900-5ce2-4ef9-bd44-767547ad3ce6 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:18.274785 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6da77900-5ce2-4ef9-bd44-767547ad3ce6 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:18.283574 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6da77900-5ce2-4ef9-bd44-767547ad3ce6 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:18.284179 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6da77900-5ce2-4ef9-bd44-767547ad3ce6 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:18.285100 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6da77900-5ce2-4ef9-bd44-767547ad3ce6 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:18.285676 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6da77900-5ce2-4ef9-bd44-767547ad3ce6 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:18.398281 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6da77900-5ce2-4ef9-bd44-767547ad3ce6 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 28653 microversion: 2.1 time: 0.129703 Apr 15 20:01:18.399033 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 478/1038] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:01:18 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 28653 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:01:18.966039 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a305da01-e7e8-4247-8903-51374b7abc2c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:18.967137 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a305da01-e7e8-4247-8903-51374b7abc2c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:18.975473 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a305da01-e7e8-4247-8903-51374b7abc2c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:18.975979 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a305da01-e7e8-4247-8903-51374b7abc2c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:18.976860 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a305da01-e7e8-4247-8903-51374b7abc2c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:18.977401 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a305da01-e7e8-4247-8903-51374b7abc2c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:19.197616 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a305da01-e7e8-4247-8903-51374b7abc2c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:19.207857 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a305da01-e7e8-4247-8903-51374b7abc2c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:19.209802 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a305da01-e7e8-4247-8903-51374b7abc2c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:19.211265 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a305da01-e7e8-4247-8903-51374b7abc2c tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1740 microversion: 2.20 time: 0.249797 Apr 15 20:01:19.212417 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 561/1039] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:18 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1740 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 20:01:19.411248 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-3a37d552-afbc-4108-9543-6d4a68a3fe9f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:19.412727 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-3a37d552-afbc-4108-9543-6d4a68a3fe9f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:19.421833 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3a37d552-afbc-4108-9543-6d4a68a3fe9f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:19.422342 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3a37d552-afbc-4108-9543-6d4a68a3fe9f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:19.423178 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3a37d552-afbc-4108-9543-6d4a68a3fe9f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:19.423698 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3a37d552-afbc-4108-9543-6d4a68a3fe9f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:19.530759 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-3a37d552-afbc-4108-9543-6d4a68a3fe9f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 28653 microversion: 2.1 time: 0.124075 Apr 15 20:01:19.531441 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 479/1040] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:01:19 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 28653 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:01:20.231649 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9089e17c-1952-40f7-9b1c-98525276d896 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:20.232439 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9089e17c-1952-40f7-9b1c-98525276d896 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:20.240433 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9089e17c-1952-40f7-9b1c-98525276d896 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:20.240973 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9089e17c-1952-40f7-9b1c-98525276d896 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:20.241849 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9089e17c-1952-40f7-9b1c-98525276d896 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:20.242350 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9089e17c-1952-40f7-9b1c-98525276d896 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:20.457187 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9089e17c-1952-40f7-9b1c-98525276d896 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:20.467121 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9089e17c-1952-40f7-9b1c-98525276d896 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:20.468829 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9089e17c-1952-40f7-9b1c-98525276d896 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:20.470049 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9089e17c-1952-40f7-9b1c-98525276d896 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1722 microversion: 2.20 time: 0.242664 Apr 15 20:01:20.470665 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 562/1041] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:20 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 20:01:20.544473 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-02afe57c-c704-4053-81c9-ba13f63d8a62 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:20.545604 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-02afe57c-c704-4053-81c9-ba13f63d8a62 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:20.554076 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-02afe57c-c704-4053-81c9-ba13f63d8a62 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:20.554577 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-02afe57c-c704-4053-81c9-ba13f63d8a62 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:20.555429 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-02afe57c-c704-4053-81c9-ba13f63d8a62 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:20.555924 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-02afe57c-c704-4053-81c9-ba13f63d8a62 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:20.655409 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-02afe57c-c704-4053-81c9-ba13f63d8a62 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 28653 microversion: 2.1 time: 0.115736 Apr 15 20:01:20.657078 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 480/1042] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:01:20 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 28653 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:01:21.490406 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-95f76cf4-daec-43b6-8524-fe18cc9540ec tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:21.490999 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-95f76cf4-daec-43b6-8524-fe18cc9540ec tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:21.499226 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-95f76cf4-daec-43b6-8524-fe18cc9540ec tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:21.499779 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-95f76cf4-daec-43b6-8524-fe18cc9540ec tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:21.500604 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-95f76cf4-daec-43b6-8524-fe18cc9540ec tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:21.501089 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-95f76cf4-daec-43b6-8524-fe18cc9540ec tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:21.668740 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9314bc0e-986d-4f89-8b5a-e3cf841b806c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:21.670123 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9314bc0e-986d-4f89-8b5a-e3cf841b806c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:21.678741 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9314bc0e-986d-4f89-8b5a-e3cf841b806c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:21.679252 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9314bc0e-986d-4f89-8b5a-e3cf841b806c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:21.680113 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9314bc0e-986d-4f89-8b5a-e3cf841b806c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:21.680623 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9314bc0e-986d-4f89-8b5a-e3cf841b806c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:21.718000 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-95f76cf4-daec-43b6-8524-fe18cc9540ec tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:21.727602 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-95f76cf4-daec-43b6-8524-fe18cc9540ec tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:21.729270 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-95f76cf4-daec-43b6-8524-fe18cc9540ec tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:21.730483 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-95f76cf4-daec-43b6-8524-fe18cc9540ec tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1722 microversion: 2.20 time: 0.244334 Apr 15 20:01:21.731338 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 563/1043] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:21 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 20:01:21.785550 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9314bc0e-986d-4f89-8b5a-e3cf841b806c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 28653 microversion: 2.1 time: 0.121130 Apr 15 20:01:21.786228 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 481/1044] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:01:21 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 28653 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:01:22.750266 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-910f407f-3e67-4ca6-9f11-d1600e14c5ae tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:22.750931 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-910f407f-3e67-4ca6-9f11-d1600e14c5ae tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:22.758945 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-910f407f-3e67-4ca6-9f11-d1600e14c5ae tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:22.759484 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-910f407f-3e67-4ca6-9f11-d1600e14c5ae tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:22.760318 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-910f407f-3e67-4ca6-9f11-d1600e14c5ae tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:22.760804 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-910f407f-3e67-4ca6-9f11-d1600e14c5ae tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:22.798851 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-8993d659-89b6-406d-ad30-49dd162ad211 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:22.800029 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-8993d659-89b6-406d-ad30-49dd162ad211 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:22.808567 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8993d659-89b6-406d-ad30-49dd162ad211 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:22.809086 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8993d659-89b6-406d-ad30-49dd162ad211 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:22.809931 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8993d659-89b6-406d-ad30-49dd162ad211 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:22.810432 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8993d659-89b6-406d-ad30-49dd162ad211 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:22.914462 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-8993d659-89b6-406d-ad30-49dd162ad211 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 28653 microversion: 2.1 time: 0.119945 Apr 15 20:01:22.915228 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 482/1045] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:01:22 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 28653 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:01:22.979813 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-910f407f-3e67-4ca6-9f11-d1600e14c5ae tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:22.989199 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-910f407f-3e67-4ca6-9f11-d1600e14c5ae tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:22.990864 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-910f407f-3e67-4ca6-9f11-d1600e14c5ae tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:22.992108 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-910f407f-3e67-4ca6-9f11-d1600e14c5ae tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1722 microversion: 2.20 time: 0.245944 Apr 15 20:01:22.992717 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 564/1046] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:22 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 20:01:23.641973 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-5a063c6e-0687-45b4-8c21-03a1270ac17b req-d5147650-a6da-4142-8c56-76f4a20f3648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aac757a2-25b5-4006-abd0-4b3aa0b5ae08", "name": "network-vif-unplugged", "status": "completed", "tag": "094b251a-1524-4ff8-b586-45456b2a7026"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:23.643689 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:01:23.643689 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:01:23.653882 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-5a063c6e-0687-45b4-8c21-03a1270ac17b req-d5147650-a6da-4142-8c56-76f4a20f3648 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:23.654379 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-5a063c6e-0687-45b4-8c21-03a1270ac17b req-d5147650-a6da-4142-8c56-76f4a20f3648 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:23.672411 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.compute.server_external_events [req-5a063c6e-0687-45b4-8c21-03a1270ac17b req-d5147650-a6da-4142-8c56-76f4a20f3648 service nova] Unable to find a host for instance aac757a2-25b5-4006-abd0-4b3aa0b5ae08. Dropping event network-vif-unplugged {{(pid=99512) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:141}} Apr 15 20:01:23.673402 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-5a063c6e-0687-45b4-8c21-03a1270ac17b req-d5147650-a6da-4142-8c56-76f4a20f3648 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036058 Apr 15 20:01:23.674190 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 483/1047] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:01:23 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 15 20:01:23.926832 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-af71b4cd-6c36-4ffc-b1bb-790a99f6b525 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:23.927983 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-af71b4cd-6c36-4ffc-b1bb-790a99f6b525 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:23.935780 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-af71b4cd-6c36-4ffc-b1bb-790a99f6b525 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:23.936286 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-af71b4cd-6c36-4ffc-b1bb-790a99f6b525 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:23.937113 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-af71b4cd-6c36-4ffc-b1bb-790a99f6b525 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:23.937607 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-af71b4cd-6c36-4ffc-b1bb-790a99f6b525 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:24.012057 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-87ccfcb8-9df4-47b9-bf93-ae4f9bac3ad2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:24.012865 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-87ccfcb8-9df4-47b9-bf93-ae4f9bac3ad2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:24.020775 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-87ccfcb8-9df4-47b9-bf93-ae4f9bac3ad2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:24.021293 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-87ccfcb8-9df4-47b9-bf93-ae4f9bac3ad2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:24.022128 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-87ccfcb8-9df4-47b9-bf93-ae4f9bac3ad2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:24.022626 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-87ccfcb8-9df4-47b9-bf93-ae4f9bac3ad2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:24.032712 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-af71b4cd-6c36-4ffc-b1bb-790a99f6b525 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 28653 microversion: 2.1 time: 0.109682 Apr 15 20:01:24.033617 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 565/1048] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:01:23 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 28653 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:01:24.459818 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-87ccfcb8-9df4-47b9-bf93-ae4f9bac3ad2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:24.469314 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-87ccfcb8-9df4-47b9-bf93-ae4f9bac3ad2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:24.471003 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-87ccfcb8-9df4-47b9-bf93-ae4f9bac3ad2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:24.472278 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-87ccfcb8-9df4-47b9-bf93-ae4f9bac3ad2 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1665 microversion: 2.20 time: 0.464346 Apr 15 20:01:24.472896 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 484/1049] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:24 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1665 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 20:01:24.491669 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-8c33b892-acad-493b-b9f3-a0d5b5a14690 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8c7feef-7805-4c92-9664-c3428cc24d75"}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:24.492945 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-8c33b892-acad-493b-b9f3-a0d5b5a14690 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:24.502044 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8c33b892-acad-493b-b9f3-a0d5b5a14690 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:24.502551 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8c33b892-acad-493b-b9f3-a0d5b5a14690 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:24.503410 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8c33b892-acad-493b-b9f3-a0d5b5a14690 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:24.503906 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8c33b892-acad-493b-b9f3-a0d5b5a14690 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:24.932233 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-8c33b892-acad-493b-b9f3-a0d5b5a14690 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.445235 Apr 15 20:01:24.932890 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 566/1050] 10.222.0.58 () {62 vars in 1354 bytes} [Thu Apr 15 20:01:24 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/os-volume_attachments => generated 188 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:01:25.044066 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f1ceea95-f739-4c25-a06c-58ab05b22153 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:25.044614 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-dc9c6ba0-63b3-4974-88b1-ecf5241684ed tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:25.044722 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f1ceea95-f739-4c25-a06c-58ab05b22153 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:25.045741 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-dc9c6ba0-63b3-4974-88b1-ecf5241684ed tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:25.052989 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f1ceea95-f739-4c25-a06c-58ab05b22153 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:25.053505 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f1ceea95-f739-4c25-a06c-58ab05b22153 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:25.054072 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dc9c6ba0-63b3-4974-88b1-ecf5241684ed tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:25.054348 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f1ceea95-f739-4c25-a06c-58ab05b22153 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:25.054583 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dc9c6ba0-63b3-4974-88b1-ecf5241684ed tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:25.054851 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f1ceea95-f739-4c25-a06c-58ab05b22153 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:25.055468 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dc9c6ba0-63b3-4974-88b1-ecf5241684ed tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:25.055968 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dc9c6ba0-63b3-4974-88b1-ecf5241684ed tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:25.157326 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-dc9c6ba0-63b3-4974-88b1-ecf5241684ed tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 28653 microversion: 2.1 time: 0.116333 Apr 15 20:01:25.158241 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 567/1051] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:01:25 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 28653 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:01:25.482159 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f1ceea95-f739-4c25-a06c-58ab05b22153 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "DELETE /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/os-volume_attachments/f8c7feef-7805-4c92-9664-c3428cc24d75" status: 202 len: 0 microversion: 2.20 time: 0.441800 Apr 15 20:01:25.482832 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 485/1052] 10.222.0.58 () {60 vars in 1447 bytes} [Thu Apr 15 20:01:25 2021] DELETE /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/os-volume_attachments/f8c7feef-7805-4c92-9664-c3428cc24d75 => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 15 20:01:25.585543 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b84c2250-5f28-4ebf-99de-2f63bc898eda tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:25.586270 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b84c2250-5f28-4ebf-99de-2f63bc898eda tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:25.595400 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b84c2250-5f28-4ebf-99de-2f63bc898eda tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:25.595908 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b84c2250-5f28-4ebf-99de-2f63bc898eda tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:25.596747 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b84c2250-5f28-4ebf-99de-2f63bc898eda tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:25.597238 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b84c2250-5f28-4ebf-99de-2f63bc898eda tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:25.748058 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b84c2250-5f28-4ebf-99de-2f63bc898eda tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action" status: 202 len: 0 microversion: 2.20 time: 0.167092 Apr 15 20:01:25.751610 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 568/1053] 10.222.0.58 () {62 vars in 1309 bytes} [Thu Apr 15 20:01:25 2021] POST /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 15 20:01:25.757219 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9b6bdb80-fde5-491b-96ab-fbf58cff7458 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:25.757883 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9b6bdb80-fde5-491b-96ab-fbf58cff7458 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:25.765633 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9b6bdb80-fde5-491b-96ab-fbf58cff7458 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:25.766137 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9b6bdb80-fde5-491b-96ab-fbf58cff7458 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:25.766967 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9b6bdb80-fde5-491b-96ab-fbf58cff7458 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:25.767480 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9b6bdb80-fde5-491b-96ab-fbf58cff7458 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:25.983777 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9b6bdb80-fde5-491b-96ab-fbf58cff7458 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:25.993552 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9b6bdb80-fde5-491b-96ab-fbf58cff7458 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:25.995287 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9b6bdb80-fde5-491b-96ab-fbf58cff7458 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:25.996535 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9b6bdb80-fde5-491b-96ab-fbf58cff7458 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1673 microversion: 2.20 time: 0.243381 Apr 15 20:01:25.997143 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 486/1054] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:25 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1673 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 20:01:26.170380 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-13b67ce7-8b8f-4e43-9c8b-6bb45d8d6beb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:26.171570 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-13b67ce7-8b8f-4e43-9c8b-6bb45d8d6beb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:26.179425 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-13b67ce7-8b8f-4e43-9c8b-6bb45d8d6beb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:26.179942 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-13b67ce7-8b8f-4e43-9c8b-6bb45d8d6beb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:26.180786 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-13b67ce7-8b8f-4e43-9c8b-6bb45d8d6beb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:26.181287 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-13b67ce7-8b8f-4e43-9c8b-6bb45d8d6beb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:26.281974 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-13b67ce7-8b8f-4e43-9c8b-6bb45d8d6beb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 28653 microversion: 2.1 time: 0.116122 Apr 15 20:01:26.282882 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 569/1055] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:01:26 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 28653 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:01:27.016750 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6cb0529e-e38e-4d12-b012-c579216caf0f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:27.017322 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6cb0529e-e38e-4d12-b012-c579216caf0f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:27.025386 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6cb0529e-e38e-4d12-b012-c579216caf0f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:27.025889 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6cb0529e-e38e-4d12-b012-c579216caf0f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:27.026725 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6cb0529e-e38e-4d12-b012-c579216caf0f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:27.027215 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6cb0529e-e38e-4d12-b012-c579216caf0f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:27.238738 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-6cb0529e-e38e-4d12-b012-c579216caf0f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:27.248399 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-6cb0529e-e38e-4d12-b012-c579216caf0f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:27.250085 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-6cb0529e-e38e-4d12-b012-c579216caf0f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:27.251341 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6cb0529e-e38e-4d12-b012-c579216caf0f tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1675 microversion: 2.20 time: 0.238988 Apr 15 20:01:27.252158 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 487/1056] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:27 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1675 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 20:01:27.295245 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-22355802-8f36-4bc6-88d1-98474063b77a tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:27.296420 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-22355802-8f36-4bc6-88d1-98474063b77a tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:27.305036 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-22355802-8f36-4bc6-88d1-98474063b77a tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:27.305549 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-22355802-8f36-4bc6-88d1-98474063b77a tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:27.306386 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-22355802-8f36-4bc6-88d1-98474063b77a tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:27.306885 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-22355802-8f36-4bc6-88d1-98474063b77a tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:27.405293 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-22355802-8f36-4bc6-88d1-98474063b77a tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 28653 microversion: 2.1 time: 0.114393 Apr 15 20:01:27.405988 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 570/1057] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:01:27 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 28653 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:01:28.271615 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b19d14c3-ebff-4583-a882-77c4d17983a5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:28.272189 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b19d14c3-ebff-4583-a882-77c4d17983a5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:28.280056 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b19d14c3-ebff-4583-a882-77c4d17983a5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:28.280639 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b19d14c3-ebff-4583-a882-77c4d17983a5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:28.281398 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b19d14c3-ebff-4583-a882-77c4d17983a5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:28.281888 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b19d14c3-ebff-4583-a882-77c4d17983a5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:28.419747 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-28d03afe-c892-4b96-af5d-e59cb26fbb91 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:28.420878 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-28d03afe-c892-4b96-af5d-e59cb26fbb91 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:28.430122 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-28d03afe-c892-4b96-af5d-e59cb26fbb91 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:28.430636 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-28d03afe-c892-4b96-af5d-e59cb26fbb91 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:28.431518 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-28d03afe-c892-4b96-af5d-e59cb26fbb91 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:28.431996 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-28d03afe-c892-4b96-af5d-e59cb26fbb91 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:28.509847 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b19d14c3-ebff-4583-a882-77c4d17983a5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:28.520124 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b19d14c3-ebff-4583-a882-77c4d17983a5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:28.521848 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b19d14c3-ebff-4583-a882-77c4d17983a5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:28.523016 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b19d14c3-ebff-4583-a882-77c4d17983a5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1731 microversion: 2.20 time: 0.255580 Apr 15 20:01:28.523669 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 488/1058] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:28 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1731 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 20:01:28.539340 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-28d03afe-c892-4b96-af5d-e59cb26fbb91 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 28653 microversion: 2.1 time: 0.124559 Apr 15 20:01:28.544563 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 571/1059] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:01:28 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 28653 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:01:29.543145 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-80124197-9515-4402-81d0-6a509a884ff6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:29.544426 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-80124197-9515-4402-81d0-6a509a884ff6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:29.552583 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-80124197-9515-4402-81d0-6a509a884ff6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:29.553096 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-80124197-9515-4402-81d0-6a509a884ff6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:29.553479 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-01c11c89-e41d-479e-b59d-7dfdc906694b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:29.553948 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-80124197-9515-4402-81d0-6a509a884ff6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:29.554448 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-80124197-9515-4402-81d0-6a509a884ff6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:29.554605 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-01c11c89-e41d-479e-b59d-7dfdc906694b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:29.564247 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-01c11c89-e41d-479e-b59d-7dfdc906694b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:29.564759 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-01c11c89-e41d-479e-b59d-7dfdc906694b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:29.565587 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-01c11c89-e41d-479e-b59d-7dfdc906694b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:29.566302 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-01c11c89-e41d-479e-b59d-7dfdc906694b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:29.796077 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-80124197-9515-4402-81d0-6a509a884ff6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:29.805889 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-80124197-9515-4402-81d0-6a509a884ff6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:29.807654 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-80124197-9515-4402-81d0-6a509a884ff6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:29.808873 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-80124197-9515-4402-81d0-6a509a884ff6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1731 microversion: 2.20 time: 0.270405 Apr 15 20:01:29.809486 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 489/1060] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:29 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1731 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 20:01:30.829831 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d7cfcf51-4b54-4ffa-ac8b-336d71dd3068 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:30.830501 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d7cfcf51-4b54-4ffa-ac8b-336d71dd3068 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:30.838410 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d7cfcf51-4b54-4ffa-ac8b-336d71dd3068 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:30.838916 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d7cfcf51-4b54-4ffa-ac8b-336d71dd3068 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:30.839776 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d7cfcf51-4b54-4ffa-ac8b-336d71dd3068 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:30.840269 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d7cfcf51-4b54-4ffa-ac8b-336d71dd3068 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:31.059387 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d7cfcf51-4b54-4ffa-ac8b-336d71dd3068 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:31.069780 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d7cfcf51-4b54-4ffa-ac8b-336d71dd3068 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:31.071592 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d7cfcf51-4b54-4ffa-ac8b-336d71dd3068 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:31.072921 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d7cfcf51-4b54-4ffa-ac8b-336d71dd3068 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1731 microversion: 2.20 time: 0.247275 Apr 15 20:01:31.073534 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 490/1061] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:30 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1731 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 20:01:32.093529 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-53feaf66-852a-4515-b311-d025c97f7595 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:32.094186 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-53feaf66-852a-4515-b311-d025c97f7595 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:32.102442 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-53feaf66-852a-4515-b311-d025c97f7595 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:32.102948 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-53feaf66-852a-4515-b311-d025c97f7595 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:32.103811 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-53feaf66-852a-4515-b311-d025c97f7595 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:32.104301 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-53feaf66-852a-4515-b311-d025c97f7595 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:32.325797 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-53feaf66-852a-4515-b311-d025c97f7595 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:32.335814 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-53feaf66-852a-4515-b311-d025c97f7595 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:32.337489 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-53feaf66-852a-4515-b311-d025c97f7595 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:32.338711 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-53feaf66-852a-4515-b311-d025c97f7595 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1731 microversion: 2.20 time: 0.249857 Apr 15 20:01:32.339342 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 491/1062] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:32 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1731 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 20:01:33.359205 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e660527b-63d5-4afa-af41-373ed83e9bea tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:33.359914 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e660527b-63d5-4afa-af41-373ed83e9bea tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:33.367886 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e660527b-63d5-4afa-af41-373ed83e9bea tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:33.368396 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e660527b-63d5-4afa-af41-373ed83e9bea tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:33.369219 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e660527b-63d5-4afa-af41-373ed83e9bea tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:33.369707 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e660527b-63d5-4afa-af41-373ed83e9bea tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:33.591208 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-e660527b-63d5-4afa-af41-373ed83e9bea tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:33.600939 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-e660527b-63d5-4afa-af41-373ed83e9bea tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:33.602603 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-e660527b-63d5-4afa-af41-373ed83e9bea tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:33.603848 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e660527b-63d5-4afa-af41-373ed83e9bea tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1731 microversion: 2.20 time: 0.249274 Apr 15 20:01:33.604457 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 492/1063] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:33 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1731 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 20:01:34.625998 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-8fad9f34-af24-4fb1-9047-f0523bfd4c9a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:34.627529 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-8fad9f34-af24-4fb1-9047-f0523bfd4c9a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:34.635788 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8fad9f34-af24-4fb1-9047-f0523bfd4c9a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:34.636547 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8fad9f34-af24-4fb1-9047-f0523bfd4c9a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:34.637834 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8fad9f34-af24-4fb1-9047-f0523bfd4c9a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:34.638450 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8fad9f34-af24-4fb1-9047-f0523bfd4c9a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:34.860237 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-8fad9f34-af24-4fb1-9047-f0523bfd4c9a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:34.870325 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-8fad9f34-af24-4fb1-9047-f0523bfd4c9a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:34.872806 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-8fad9f34-af24-4fb1-9047-f0523bfd4c9a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:34.874035 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-8fad9f34-af24-4fb1-9047-f0523bfd4c9a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1731 microversion: 2.20 time: 0.253615 Apr 15 20:01:34.874865 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 493/1064] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:34 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1731 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 20:01:35.893419 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-4f5c3416-4c12-4e85-ad36-dfd16d8d2def tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:35.894108 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-4f5c3416-4c12-4e85-ad36-dfd16d8d2def tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:35.901941 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4f5c3416-4c12-4e85-ad36-dfd16d8d2def tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:35.902444 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4f5c3416-4c12-4e85-ad36-dfd16d8d2def tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:35.903842 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4f5c3416-4c12-4e85-ad36-dfd16d8d2def tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:35.904305 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4f5c3416-4c12-4e85-ad36-dfd16d8d2def tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:36.123558 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-4f5c3416-4c12-4e85-ad36-dfd16d8d2def tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:36.133183 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-4f5c3416-4c12-4e85-ad36-dfd16d8d2def tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:36.134847 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-4f5c3416-4c12-4e85-ad36-dfd16d8d2def tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:36.136136 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-4f5c3416-4c12-4e85-ad36-dfd16d8d2def tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1731 microversion: 2.20 time: 0.246818 Apr 15 20:01:36.136741 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 494/1065] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:35 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1731 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 20:01:37.157651 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9bf95d99-7272-4e00-a05c-6a8c47fd6c82 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:37.158311 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9bf95d99-7272-4e00-a05c-6a8c47fd6c82 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:37.166569 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9bf95d99-7272-4e00-a05c-6a8c47fd6c82 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:37.167072 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9bf95d99-7272-4e00-a05c-6a8c47fd6c82 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:37.167960 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9bf95d99-7272-4e00-a05c-6a8c47fd6c82 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:37.168451 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9bf95d99-7272-4e00-a05c-6a8c47fd6c82 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:37.387557 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9bf95d99-7272-4e00-a05c-6a8c47fd6c82 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:37.397692 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9bf95d99-7272-4e00-a05c-6a8c47fd6c82 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:37.399425 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9bf95d99-7272-4e00-a05c-6a8c47fd6c82 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:37.400873 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9bf95d99-7272-4e00-a05c-6a8c47fd6c82 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1731 microversion: 2.20 time: 0.247603 Apr 15 20:01:37.401540 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 495/1066] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:37 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1731 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 20:01:38.421649 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ec0e159b-adc7-4289-bbfa-09e21f3fd432 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:38.422323 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ec0e159b-adc7-4289-bbfa-09e21f3fd432 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:38.430204 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ec0e159b-adc7-4289-bbfa-09e21f3fd432 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:38.430718 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ec0e159b-adc7-4289-bbfa-09e21f3fd432 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:38.431582 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ec0e159b-adc7-4289-bbfa-09e21f3fd432 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:38.432080 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ec0e159b-adc7-4289-bbfa-09e21f3fd432 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:38.657537 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ec0e159b-adc7-4289-bbfa-09e21f3fd432 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:38.667637 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ec0e159b-adc7-4289-bbfa-09e21f3fd432 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:38.669438 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ec0e159b-adc7-4289-bbfa-09e21f3fd432 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:38.671255 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ec0e159b-adc7-4289-bbfa-09e21f3fd432 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1731 microversion: 2.20 time: 0.254317 Apr 15 20:01:38.671951 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 496/1067] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:38 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1731 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 20:01:39.692832 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-09386082-968a-4d54-9d69-9b25a78b0ccc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:39.693502 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-09386082-968a-4d54-9d69-9b25a78b0ccc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:39.702453 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-09386082-968a-4d54-9d69-9b25a78b0ccc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:39.702956 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-09386082-968a-4d54-9d69-9b25a78b0ccc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:39.703807 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-09386082-968a-4d54-9d69-9b25a78b0ccc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:39.704305 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-09386082-968a-4d54-9d69-9b25a78b0ccc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:39.924288 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-09386082-968a-4d54-9d69-9b25a78b0ccc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:39.935104 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-09386082-968a-4d54-9d69-9b25a78b0ccc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:39.937159 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-09386082-968a-4d54-9d69-9b25a78b0ccc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:39.938617 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-09386082-968a-4d54-9d69-9b25a78b0ccc tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1731 microversion: 2.20 time: 0.249777 Apr 15 20:01:39.939370 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 497/1068] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:39 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1731 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 20:01:40.958561 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-39164613-afb8-4a3e-9644-109c58711023 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:40.959236 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-39164613-afb8-4a3e-9644-109c58711023 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:40.967167 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-39164613-afb8-4a3e-9644-109c58711023 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:40.967662 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-39164613-afb8-4a3e-9644-109c58711023 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:40.968487 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-39164613-afb8-4a3e-9644-109c58711023 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:40.968972 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-39164613-afb8-4a3e-9644-109c58711023 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:41.240383 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-39164613-afb8-4a3e-9644-109c58711023 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:41.250335 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-39164613-afb8-4a3e-9644-109c58711023 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:41.252033 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-39164613-afb8-4a3e-9644-109c58711023 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:41.253266 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-39164613-afb8-4a3e-9644-109c58711023 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1731 microversion: 2.20 time: 0.298761 Apr 15 20:01:41.253847 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 498/1069] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:40 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1731 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 20:01:42.272527 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d8e4f192-4532-4d80-8064-2c396eda6b9a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:42.273191 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d8e4f192-4532-4d80-8064-2c396eda6b9a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:42.281695 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d8e4f192-4532-4d80-8064-2c396eda6b9a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:42.282199 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d8e4f192-4532-4d80-8064-2c396eda6b9a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:42.283022 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d8e4f192-4532-4d80-8064-2c396eda6b9a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:42.283541 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d8e4f192-4532-4d80-8064-2c396eda6b9a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:42.494698 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d8e4f192-4532-4d80-8064-2c396eda6b9a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:42.504082 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d8e4f192-4532-4d80-8064-2c396eda6b9a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:42.505747 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d8e4f192-4532-4d80-8064-2c396eda6b9a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:42.506992 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d8e4f192-4532-4d80-8064-2c396eda6b9a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1731 microversion: 2.20 time: 0.238542 Apr 15 20:01:42.507634 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 499/1070] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:42 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1731 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 15 20:01:43.375441 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-01c11c89-e41d-479e-b59d-7dfdc906694b tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 28653 microversion: 2.1 time: 13.826387 Apr 15 20:01:43.376159 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 572/1071] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:01:29 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 28653 bytes in 13828 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:01:43.526241 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-827877f9-7ae1-425a-83f8-27fca2321eca tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:43.526914 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-827877f9-7ae1-425a-83f8-27fca2321eca tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:43.534785 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-827877f9-7ae1-425a-83f8-27fca2321eca tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:43.535304 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-827877f9-7ae1-425a-83f8-27fca2321eca tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:43.536156 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-827877f9-7ae1-425a-83f8-27fca2321eca tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:43.536655 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-827877f9-7ae1-425a-83f8-27fca2321eca tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:43.751170 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-827877f9-7ae1-425a-83f8-27fca2321eca tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:43.760584 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-827877f9-7ae1-425a-83f8-27fca2321eca tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:43.762259 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-827877f9-7ae1-425a-83f8-27fca2321eca tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:43.763506 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-827877f9-7ae1-425a-83f8-27fca2321eca tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1731 microversion: 2.20 time: 0.241328 Apr 15 20:01:43.764110 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 500/1072] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:43 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1731 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 20:01:44.388148 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ec4bb894-e85f-40ea-b641-06c21077e1e4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:44.389324 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ec4bb894-e85f-40ea-b641-06c21077e1e4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:44.397912 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ec4bb894-e85f-40ea-b641-06c21077e1e4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:44.398429 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ec4bb894-e85f-40ea-b641-06c21077e1e4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:44.399301 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ec4bb894-e85f-40ea-b641-06c21077e1e4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:44.399797 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ec4bb894-e85f-40ea-b641-06c21077e1e4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:44.496342 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ec4bb894-e85f-40ea-b641-06c21077e1e4 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 28653 microversion: 2.1 time: 0.112610 Apr 15 20:01:44.497016 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 573/1073] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:01:44 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 28653 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:01:44.783850 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9c2ab09d-350c-4590-9984-410d0a5b3c23 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:44.784566 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9c2ab09d-350c-4590-9984-410d0a5b3c23 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:44.792721 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9c2ab09d-350c-4590-9984-410d0a5b3c23 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:44.793228 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9c2ab09d-350c-4590-9984-410d0a5b3c23 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:44.794062 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9c2ab09d-350c-4590-9984-410d0a5b3c23 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:44.794559 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9c2ab09d-350c-4590-9984-410d0a5b3c23 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:45.005272 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9c2ab09d-350c-4590-9984-410d0a5b3c23 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:45.015186 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9c2ab09d-350c-4590-9984-410d0a5b3c23 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:45.016880 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9c2ab09d-350c-4590-9984-410d0a5b3c23 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:45.018101 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9c2ab09d-350c-4590-9984-410d0a5b3c23 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1731 microversion: 2.20 time: 0.239090 Apr 15 20:01:45.018706 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 501/1074] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:44 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1731 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 20:01:45.510043 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-800a73cb-6a28-4fed-a49d-25c1e0cc78d3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:45.511218 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-800a73cb-6a28-4fed-a49d-25c1e0cc78d3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:45.519839 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-800a73cb-6a28-4fed-a49d-25c1e0cc78d3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:45.520349 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-800a73cb-6a28-4fed-a49d-25c1e0cc78d3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:45.521173 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-800a73cb-6a28-4fed-a49d-25c1e0cc78d3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:45.521662 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-800a73cb-6a28-4fed-a49d-25c1e0cc78d3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:45.622357 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-800a73cb-6a28-4fed-a49d-25c1e0cc78d3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 28653 microversion: 2.1 time: 0.116680 Apr 15 20:01:45.623068 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 574/1075] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:01:45 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 28653 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:01:46.037994 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-de3b43ec-20a5-4860-b9ff-9e88beadd1ba tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:46.038651 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-de3b43ec-20a5-4860-b9ff-9e88beadd1ba tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:46.047049 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-de3b43ec-20a5-4860-b9ff-9e88beadd1ba tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:46.047576 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-de3b43ec-20a5-4860-b9ff-9e88beadd1ba tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:46.048405 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-de3b43ec-20a5-4860-b9ff-9e88beadd1ba tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:46.048890 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-de3b43ec-20a5-4860-b9ff-9e88beadd1ba tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:46.258858 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-de3b43ec-20a5-4860-b9ff-9e88beadd1ba tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:46.268252 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-de3b43ec-20a5-4860-b9ff-9e88beadd1ba tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:46.269920 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-de3b43ec-20a5-4860-b9ff-9e88beadd1ba tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:46.271126 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-de3b43ec-20a5-4860-b9ff-9e88beadd1ba tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1731 microversion: 2.20 time: 0.237473 Apr 15 20:01:46.271773 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 502/1076] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:46 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1731 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 20:01:46.635638 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9c518096-689e-464b-802c-2a22bced6f79 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:46.636791 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9c518096-689e-464b-802c-2a22bced6f79 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:46.646034 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9c518096-689e-464b-802c-2a22bced6f79 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:46.646552 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9c518096-689e-464b-802c-2a22bced6f79 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:46.647420 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9c518096-689e-464b-802c-2a22bced6f79 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:46.647925 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9c518096-689e-464b-802c-2a22bced6f79 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:46.760429 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9c518096-689e-464b-802c-2a22bced6f79 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 28653 microversion: 2.1 time: 0.129189 Apr 15 20:01:46.761115 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 575/1077] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:01:46 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 28653 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:01:47.291209 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-0ad16bf9-a726-4816-8f26-7ef46dc6ebdd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:47.291902 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-0ad16bf9-a726-4816-8f26-7ef46dc6ebdd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:47.300437 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0ad16bf9-a726-4816-8f26-7ef46dc6ebdd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:47.300946 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0ad16bf9-a726-4816-8f26-7ef46dc6ebdd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:47.301773 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0ad16bf9-a726-4816-8f26-7ef46dc6ebdd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:47.302264 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0ad16bf9-a726-4816-8f26-7ef46dc6ebdd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:47.514706 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-0ad16bf9-a726-4816-8f26-7ef46dc6ebdd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:47.524013 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-0ad16bf9-a726-4816-8f26-7ef46dc6ebdd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:47.525707 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-0ad16bf9-a726-4816-8f26-7ef46dc6ebdd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:47.526911 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-0ad16bf9-a726-4816-8f26-7ef46dc6ebdd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1731 microversion: 2.20 time: 0.240120 Apr 15 20:01:47.527583 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 503/1078] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:47 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1731 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 20:01:47.773563 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-190e4afe-b5b7-455f-853c-874772193f61 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:47.774720 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-190e4afe-b5b7-455f-853c-874772193f61 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:47.783313 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-190e4afe-b5b7-455f-853c-874772193f61 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:47.783863 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-190e4afe-b5b7-455f-853c-874772193f61 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:47.784706 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-190e4afe-b5b7-455f-853c-874772193f61 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:47.785202 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-190e4afe-b5b7-455f-853c-874772193f61 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:47.883840 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-190e4afe-b5b7-455f-853c-874772193f61 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 28653 microversion: 2.1 time: 0.114478 Apr 15 20:01:47.887297 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 576/1079] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:01:47 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 28653 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:01:48.547047 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-aeb846c2-4f74-4699-9a8a-b836bec02da6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:48.547783 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-aeb846c2-4f74-4699-9a8a-b836bec02da6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:48.555768 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-aeb846c2-4f74-4699-9a8a-b836bec02da6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:48.556275 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-aeb846c2-4f74-4699-9a8a-b836bec02da6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:48.557105 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-aeb846c2-4f74-4699-9a8a-b836bec02da6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:48.557609 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-aeb846c2-4f74-4699-9a8a-b836bec02da6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:48.770389 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-aeb846c2-4f74-4699-9a8a-b836bec02da6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:48.780546 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-aeb846c2-4f74-4699-9a8a-b836bec02da6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:48.782212 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-aeb846c2-4f74-4699-9a8a-b836bec02da6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:48.783460 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-aeb846c2-4f74-4699-9a8a-b836bec02da6 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1731 microversion: 2.20 time: 0.241254 Apr 15 20:01:48.784073 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 504/1080] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:48 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1731 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 20:01:48.896718 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-bdd8f8e6-f53a-4ab3-97d7-7830e05cc955 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:48.897830 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-bdd8f8e6-f53a-4ab3-97d7-7830e05cc955 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:48.906862 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bdd8f8e6-f53a-4ab3-97d7-7830e05cc955 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:48.907402 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bdd8f8e6-f53a-4ab3-97d7-7830e05cc955 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:48.908229 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bdd8f8e6-f53a-4ab3-97d7-7830e05cc955 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:48.908719 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bdd8f8e6-f53a-4ab3-97d7-7830e05cc955 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:49.047480 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-bdd8f8e6-f53a-4ab3-97d7-7830e05cc955 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 29836 microversion: 2.1 time: 0.155075 Apr 15 20:01:49.048427 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 577/1081] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:01:48 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 29836 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:01:49.773285 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-b3bb41b7-4d8b-456c-8f03-941c96527267 req-729f7a86-9953-482d-a603-3775686658ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aac757a2-25b5-4006-abd0-4b3aa0b5ae08", "name": "network-vif-plugged", "status": "completed", "tag": "094b251a-1524-4ff8-b586-45456b2a7026"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:49.774853 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:01:49.774853 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:01:49.784708 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-b3bb41b7-4d8b-456c-8f03-941c96527267 req-729f7a86-9953-482d-a603-3775686658ba service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:49.785237 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-b3bb41b7-4d8b-456c-8f03-941c96527267 req-729f7a86-9953-482d-a603-3775686658ba service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:49.803033 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7e49b7f3-4b8c-4b67-8ea0-8657ee90a89a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:49.803768 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-b3bb41b7-4d8b-456c-8f03-941c96527267 req-729f7a86-9953-482d-a603-3775686658ba service nova] Creating event network-vif-plugged:094b251a-1524-4ff8-b586-45456b2a7026 for instance aac757a2-25b5-4006-abd0-4b3aa0b5ae08 on hv-cinder-78638 Apr 15 20:01:49.803913 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7e49b7f3-4b8c-4b67-8ea0-8657ee90a89a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:49.809420 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-b3bb41b7-4d8b-456c-8f03-941c96527267 req-729f7a86-9953-482d-a603-3775686658ba service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040251 Apr 15 20:01:49.810236 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 505/1082] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:01:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:01:49.812800 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7e49b7f3-4b8c-4b67-8ea0-8657ee90a89a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:49.813310 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7e49b7f3-4b8c-4b67-8ea0-8657ee90a89a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:49.814157 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7e49b7f3-4b8c-4b67-8ea0-8657ee90a89a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:49.814653 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7e49b7f3-4b8c-4b67-8ea0-8657ee90a89a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:50.061140 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-cd33c4f1-c881-4b1c-a815-4e4d6c8e4ae5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:50.062356 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-cd33c4f1-c881-4b1c-a815-4e4d6c8e4ae5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:50.070832 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cd33c4f1-c881-4b1c-a815-4e4d6c8e4ae5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:50.071477 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cd33c4f1-c881-4b1c-a815-4e4d6c8e4ae5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:50.072399 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cd33c4f1-c881-4b1c-a815-4e4d6c8e4ae5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:50.072963 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cd33c4f1-c881-4b1c-a815-4e4d6c8e4ae5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:50.094675 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-7e49b7f3-4b8c-4b67-8ea0-8657ee90a89a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:50.104738 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-7e49b7f3-4b8c-4b67-8ea0-8657ee90a89a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:50.106489 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-7e49b7f3-4b8c-4b67-8ea0-8657ee90a89a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:50.107764 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7e49b7f3-4b8c-4b67-8ea0-8657ee90a89a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1731 microversion: 2.20 time: 0.309422 Apr 15 20:01:50.108706 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 578/1083] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:49 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1731 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 20:01:50.255875 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-cd33c4f1-c881-4b1c-a815-4e4d6c8e4ae5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 32045 microversion: 2.1 time: 0.199773 Apr 15 20:01:50.256563 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 506/1084] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:01:50 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 32045 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 15 20:01:51.128241 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ed8ca7e6-d30c-416d-a294-48a2d890ccdd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:51.128958 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ed8ca7e6-d30c-416d-a294-48a2d890ccdd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:51.137331 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ed8ca7e6-d30c-416d-a294-48a2d890ccdd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:51.137850 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ed8ca7e6-d30c-416d-a294-48a2d890ccdd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:51.138683 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ed8ca7e6-d30c-416d-a294-48a2d890ccdd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:51.139173 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ed8ca7e6-d30c-416d-a294-48a2d890ccdd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:51.269150 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7a2253d6-4ca6-44f6-8c2f-bd4c37deeb46 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:51.270281 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7a2253d6-4ca6-44f6-8c2f-bd4c37deeb46 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:51.279058 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7a2253d6-4ca6-44f6-8c2f-bd4c37deeb46 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:51.279607 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7a2253d6-4ca6-44f6-8c2f-bd4c37deeb46 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:51.280453 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7a2253d6-4ca6-44f6-8c2f-bd4c37deeb46 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:51.280997 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7a2253d6-4ca6-44f6-8c2f-bd4c37deeb46 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:51.359750 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ed8ca7e6-d30c-416d-a294-48a2d890ccdd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:51.369194 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ed8ca7e6-d30c-416d-a294-48a2d890ccdd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:51.370853 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ed8ca7e6-d30c-416d-a294-48a2d890ccdd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:51.372097 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ed8ca7e6-d30c-416d-a294-48a2d890ccdd tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1731 microversion: 2.20 time: 0.248627 Apr 15 20:01:51.372703 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 579/1085] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:51 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1731 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 20:01:51.382874 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7a2253d6-4ca6-44f6-8c2f-bd4c37deeb46 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 33350 microversion: 2.1 time: 0.118306 Apr 15 20:01:51.383610 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 507/1086] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:01:51 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 33350 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:01:52.392561 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ba87696e-c2cf-4e60-b3f7-8ac400caf0e1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:01:52.393269 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ba87696e-c2cf-4e60-b3f7-8ac400caf0e1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:52.394879 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-efaa5ca2-283b-46ab-a872-b95b65397cf5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:52.396048 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-efaa5ca2-283b-46ab-a872-b95b65397cf5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:52.401335 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ba87696e-c2cf-4e60-b3f7-8ac400caf0e1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:52.401840 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ba87696e-c2cf-4e60-b3f7-8ac400caf0e1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:52.402673 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ba87696e-c2cf-4e60-b3f7-8ac400caf0e1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:52.403210 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ba87696e-c2cf-4e60-b3f7-8ac400caf0e1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:52.404568 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-efaa5ca2-283b-46ab-a872-b95b65397cf5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:52.405077 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-efaa5ca2-283b-46ab-a872-b95b65397cf5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:52.406419 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-efaa5ca2-283b-46ab-a872-b95b65397cf5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:52.406916 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-efaa5ca2-283b-46ab-a872-b95b65397cf5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:52.514411 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-efaa5ca2-283b-46ab-a872-b95b65397cf5 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 34279 microversion: 2.1 time: 0.123802 Apr 15 20:01:52.516640 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 508/1087] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:01:52 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 34279 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 15 20:01:52.613000 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ba87696e-c2cf-4e60-b3f7-8ac400caf0e1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:52.622341 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ba87696e-c2cf-4e60-b3f7-8ac400caf0e1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:52.624072 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ba87696e-c2cf-4e60-b3f7-8ac400caf0e1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:01:52.625339 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ba87696e-c2cf-4e60-b3f7-8ac400caf0e1 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1718 microversion: 2.20 time: 0.236908 Apr 15 20:01:52.625954 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 580/1088] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:01:52 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1718 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 20:01:53.528390 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-94f72dcd-adcf-47c8-b0a7-60bc354ccc36 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:53.529582 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-94f72dcd-adcf-47c8-b0a7-60bc354ccc36 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:53.539062 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-94f72dcd-adcf-47c8-b0a7-60bc354ccc36 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:53.539602 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-94f72dcd-adcf-47c8-b0a7-60bc354ccc36 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:53.540441 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-94f72dcd-adcf-47c8-b0a7-60bc354ccc36 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:53.540939 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-94f72dcd-adcf-47c8-b0a7-60bc354ccc36 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:53.639437 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-94f72dcd-adcf-47c8-b0a7-60bc354ccc36 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 35551 microversion: 2.1 time: 0.115524 Apr 15 20:01:53.640418 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 509/1089] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:01:53 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 35551 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:01:54.651945 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e9f69d90-c0fd-400e-b167-52920d33ffb9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:54.652976 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e9f69d90-c0fd-400e-b167-52920d33ffb9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:54.661727 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e9f69d90-c0fd-400e-b167-52920d33ffb9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:54.662482 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e9f69d90-c0fd-400e-b167-52920d33ffb9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:54.663326 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e9f69d90-c0fd-400e-b167-52920d33ffb9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:54.663819 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e9f69d90-c0fd-400e-b167-52920d33ffb9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:54.768893 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e9f69d90-c0fd-400e-b167-52920d33ffb9 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 37112 microversion: 2.1 time: 0.120845 Apr 15 20:01:54.769579 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 581/1090] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:01:54 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 37112 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:01:55.781123 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c76480a2-b2b2-44c5-bc48-ddac249a3471 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:55.782308 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c76480a2-b2b2-44c5-bc48-ddac249a3471 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:55.791250 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c76480a2-b2b2-44c5-bc48-ddac249a3471 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:55.791807 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c76480a2-b2b2-44c5-bc48-ddac249a3471 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:55.792641 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c76480a2-b2b2-44c5-bc48-ddac249a3471 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:55.793137 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c76480a2-b2b2-44c5-bc48-ddac249a3471 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:55.890531 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c76480a2-b2b2-44c5-bc48-ddac249a3471 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 38183 microversion: 2.1 time: 0.113728 Apr 15 20:01:55.891207 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 510/1091] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:01:55 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 38183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:01:56.903049 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-8f07175f-97fb-4e0c-9874-390674e5b716 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:56.904215 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-8f07175f-97fb-4e0c-9874-390674e5b716 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:56.913485 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8f07175f-97fb-4e0c-9874-390674e5b716 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:56.913992 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8f07175f-97fb-4e0c-9874-390674e5b716 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:56.914816 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8f07175f-97fb-4e0c-9874-390674e5b716 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:56.915320 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8f07175f-97fb-4e0c-9874-390674e5b716 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:57.015923 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-8f07175f-97fb-4e0c-9874-390674e5b716 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 38183 microversion: 2.1 time: 0.116587 Apr 15 20:01:57.016548 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 582/1092] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:01:56 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 38183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 15 20:01:58.029167 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-bdc4d899-ac4b-4e43-982b-a6e3ad713033 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:58.030303 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-bdc4d899-ac4b-4e43-982b-a6e3ad713033 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:58.039131 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bdc4d899-ac4b-4e43-982b-a6e3ad713033 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:58.039664 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bdc4d899-ac4b-4e43-982b-a6e3ad713033 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:58.040491 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bdc4d899-ac4b-4e43-982b-a6e3ad713033 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:58.040979 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bdc4d899-ac4b-4e43-982b-a6e3ad713033 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:58.140121 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-bdc4d899-ac4b-4e43-982b-a6e3ad713033 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 38183 microversion: 2.1 time: 0.115261 Apr 15 20:01:58.140732 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 511/1093] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:01:58 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 38183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:01:59.153338 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f624f797-e734-4cc1-80da-e3f2170fbc2f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:01:59.154482 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f624f797-e734-4cc1-80da-e3f2170fbc2f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:01:59.163447 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f624f797-e734-4cc1-80da-e3f2170fbc2f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:59.163959 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f624f797-e734-4cc1-80da-e3f2170fbc2f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:59.164794 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f624f797-e734-4cc1-80da-e3f2170fbc2f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:01:59.165288 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f624f797-e734-4cc1-80da-e3f2170fbc2f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:01:59.266842 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f624f797-e734-4cc1-80da-e3f2170fbc2f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 38183 microversion: 2.1 time: 0.118615 Apr 15 20:01:59.267561 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 583/1094] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:01:59 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 38183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:02:00.280313 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-679b8b75-8dbb-451b-864d-4638235b8dae tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:02:00.281458 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-679b8b75-8dbb-451b-864d-4638235b8dae tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:02:00.290355 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-679b8b75-8dbb-451b-864d-4638235b8dae tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:00.290871 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-679b8b75-8dbb-451b-864d-4638235b8dae tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:00.291743 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-679b8b75-8dbb-451b-864d-4638235b8dae tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:00.292248 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-679b8b75-8dbb-451b-864d-4638235b8dae tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:00.389436 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-679b8b75-8dbb-451b-864d-4638235b8dae tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action" status: 200 len: 38312 microversion: 2.1 time: 0.113500 Apr 15 20:02:00.390107 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 512/1095] 10.222.0.58 () {60 vars in 1268 bytes} [Thu Apr 15 20:02:00 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/action => generated 38312 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 15 20:02:00.401385 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-097df5c9-5064-4684-9413-5c372e194c61 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:00.402037 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-097df5c9-5064-4684-9413-5c372e194c61 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:02:00.411267 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-097df5c9-5064-4684-9413-5c372e194c61 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:00.412093 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-097df5c9-5064-4684-9413-5c372e194c61 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:00.412928 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-097df5c9-5064-4684-9413-5c372e194c61 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:00.413418 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-097df5c9-5064-4684-9413-5c372e194c61 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:00.476919 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-097df5c9-5064-4684-9413-5c372e194c61 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/ips" status: 200 len: 144 microversion: 2.1 time: 0.080030 Apr 15 20:02:00.477540 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 584/1096] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Apr 15 20:02:00 2021] GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/ips => generated 144 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:02:01.981837 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d93f7e33-d96a-4679-b9db-a2a3162df2f7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e067b943-8e16-462e-b3de-647a73a74a81"}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:02:01.983129 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d93f7e33-d96a-4679-b9db-a2a3162df2f7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:02:01.992377 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d93f7e33-d96a-4679-b9db-a2a3162df2f7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:01.992891 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d93f7e33-d96a-4679-b9db-a2a3162df2f7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:01.993729 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d93f7e33-d96a-4679-b9db-a2a3162df2f7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:01.994228 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d93f7e33-d96a-4679-b9db-a2a3162df2f7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:02.360145 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d93f7e33-d96a-4679-b9db-a2a3162df2f7 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.382707 Apr 15 20:02:02.365716 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 513/1097] 10.222.0.58 () {60 vars in 1313 bytes} [Thu Apr 15 20:02:01 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/os-volume_attachments => generated 194 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:02:04.034158 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 15 20:02:04.034591 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: Thu Apr 15 20:02:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 15 20:02:10.185874 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-0619253e-0682-454a-9ce9-17a6ca8fd478 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:10.186911 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-0619253e-0682-454a-9ce9-17a6ca8fd478 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:02:10.195729 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0619253e-0682-454a-9ce9-17a6ca8fd478 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:10.196241 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0619253e-0682-454a-9ce9-17a6ca8fd478 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:10.197079 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0619253e-0682-454a-9ce9-17a6ca8fd478 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:10.197573 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0619253e-0682-454a-9ce9-17a6ca8fd478 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:10.265086 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-0619253e-0682-454a-9ce9-17a6ca8fd478 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083275 Apr 15 20:02:10.265714 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 585/1098] 10.222.0.58 () {58 vars in 1292 bytes} [Thu Apr 15 20:02:10 2021] GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:02:10.278098 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-cc4ccc16-6963-4b2a-85c3-ce5bf3c8a730 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:10.278742 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-cc4ccc16-6963-4b2a-85c3-ce5bf3c8a730 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:02:10.287875 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cc4ccc16-6963-4b2a-85c3-ce5bf3c8a730 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:10.288386 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cc4ccc16-6963-4b2a-85c3-ce5bf3c8a730 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:10.289221 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cc4ccc16-6963-4b2a-85c3-ce5bf3c8a730 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:10.289726 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cc4ccc16-6963-4b2a-85c3-ce5bf3c8a730 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:10.359033 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-cc4ccc16-6963-4b2a-85c3-ce5bf3c8a730 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/os-volume_attachments/e067b943-8e16-462e-b3de-647a73a74a81" status: 200 len: 194 microversion: 2.1 time: 0.085984 Apr 15 20:02:10.359648 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 514/1099] 10.222.0.58 () {58 vars in 1403 bytes} [Thu Apr 15 20:02:10 2021] GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/os-volume_attachments/e067b943-8e16-462e-b3de-647a73a74a81 => generated 194 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:02:11.856212 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-197750a8-00b6-431a-894a-faa83d4a7d80 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0b4a375-3f23-448e-b057-271e8593a3b0"}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:02:11.857446 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-197750a8-00b6-431a-894a-faa83d4a7d80 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:02:11.865384 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-197750a8-00b6-431a-894a-faa83d4a7d80 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:11.865898 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-197750a8-00b6-431a-894a-faa83d4a7d80 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:11.866737 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-197750a8-00b6-431a-894a-faa83d4a7d80 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:11.867235 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-197750a8-00b6-431a-894a-faa83d4a7d80 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:12.231256 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-197750a8-00b6-431a-894a-faa83d4a7d80 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.378963 Apr 15 20:02:12.231948 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 586/1100] 10.222.0.58 () {60 vars in 1313 bytes} [Thu Apr 15 20:02:11 2021] POST /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/os-volume_attachments => generated 194 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:02:20.055630 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c6a10498-a085-4bf6-9f88-b723d5254298 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:20.056765 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c6a10498-a085-4bf6-9f88-b723d5254298 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:02:20.065164 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c6a10498-a085-4bf6-9f88-b723d5254298 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:20.065687 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c6a10498-a085-4bf6-9f88-b723d5254298 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:20.066514 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c6a10498-a085-4bf6-9f88-b723d5254298 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:20.067010 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c6a10498-a085-4bf6-9f88-b723d5254298 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:20.135908 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c6a10498-a085-4bf6-9f88-b723d5254298 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.084380 Apr 15 20:02:20.136516 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 515/1101] 10.222.0.58 () {58 vars in 1292 bytes} [Thu Apr 15 20:02:20 2021] GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/os-volume_attachments => generated 371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:02:20.367187 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d0d6e84c-1e32-4e8d-a6d7-d8402c2e195e tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:20.367868 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d0d6e84c-1e32-4e8d-a6d7-d8402c2e195e tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:02:20.376967 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d0d6e84c-1e32-4e8d-a6d7-d8402c2e195e tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:20.377490 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d0d6e84c-1e32-4e8d-a6d7-d8402c2e195e tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:20.378333 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d0d6e84c-1e32-4e8d-a6d7-d8402c2e195e tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:20.378840 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d0d6e84c-1e32-4e8d-a6d7-d8402c2e195e tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:20.450343 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d0d6e84c-1e32-4e8d-a6d7-d8402c2e195e tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/os-volume_attachments/e067b943-8e16-462e-b3de-647a73a74a81" status: 200 len: 194 microversion: 2.1 time: 0.088402 Apr 15 20:02:20.450979 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 587/1102] 10.222.0.58 () {58 vars in 1403 bytes} [Thu Apr 15 20:02:20 2021] GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/os-volume_attachments/e067b943-8e16-462e-b3de-647a73a74a81 => generated 194 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:02:20.461729 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-cb6cbe8d-e327-4c4d-97ed-46488ed455f8 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:20.462267 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-cb6cbe8d-e327-4c4d-97ed-46488ed455f8 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:02:20.470118 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cb6cbe8d-e327-4c4d-97ed-46488ed455f8 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:20.471316 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cb6cbe8d-e327-4c4d-97ed-46488ed455f8 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:20.472140 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cb6cbe8d-e327-4c4d-97ed-46488ed455f8 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:20.472631 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cb6cbe8d-e327-4c4d-97ed-46488ed455f8 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:20.642171 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.objects.instance [None req-cb6cbe8d-e327-4c4d-97ed-46488ed455f8 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lazy-loading 'services' on Instance uuid 60b02d1c-8109-44c4-a030-a1edb69e37e0 {{(pid=99512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 15 20:02:20.781063 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-cb6cbe8d-e327-4c4d-97ed-46488ed455f8 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "DELETE /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/os-volume_attachments/e067b943-8e16-462e-b3de-647a73a74a81" status: 202 len: 0 microversion: 2.1 time: 0.323254 Apr 15 20:02:20.781706 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 516/1103] 10.222.0.58 () {58 vars in 1406 bytes} [Thu Apr 15 20:02:20 2021] DELETE /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/os-volume_attachments/e067b943-8e16-462e-b3de-647a73a74a81 => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:02:23.093665 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e9729805-12fb-4653-8043-0333734c75cf tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:23.094216 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e9729805-12fb-4653-8043-0333734c75cf tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:02:23.102710 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e9729805-12fb-4653-8043-0333734c75cf tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:23.103217 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e9729805-12fb-4653-8043-0333734c75cf tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:23.104066 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e9729805-12fb-4653-8043-0333734c75cf tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:23.104551 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e9729805-12fb-4653-8043-0333734c75cf tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:23.171930 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e9729805-12fb-4653-8043-0333734c75cf tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/os-volume_attachments/a0b4a375-3f23-448e-b057-271e8593a3b0" status: 200 len: 194 microversion: 2.1 time: 0.082572 Apr 15 20:02:23.172551 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 588/1104] 10.222.0.58 () {58 vars in 1403 bytes} [Thu Apr 15 20:02:23 2021] GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/os-volume_attachments/a0b4a375-3f23-448e-b057-271e8593a3b0 => generated 194 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:02:23.184426 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-49477162-26fe-4293-b973-0b3e5e9bfd33 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:23.185115 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-49477162-26fe-4293-b973-0b3e5e9bfd33 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:02:23.193791 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-49477162-26fe-4293-b973-0b3e5e9bfd33 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:23.194299 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-49477162-26fe-4293-b973-0b3e5e9bfd33 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:23.195127 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-49477162-26fe-4293-b973-0b3e5e9bfd33 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:23.195646 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-49477162-26fe-4293-b973-0b3e5e9bfd33 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:23.367652 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.objects.instance [None req-49477162-26fe-4293-b973-0b3e5e9bfd33 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lazy-loading 'services' on Instance uuid 60b02d1c-8109-44c4-a030-a1edb69e37e0 {{(pid=99512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 15 20:02:23.507474 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-49477162-26fe-4293-b973-0b3e5e9bfd33 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "DELETE /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/os-volume_attachments/a0b4a375-3f23-448e-b057-271e8593a3b0" status: 202 len: 0 microversion: 2.1 time: 0.327601 Apr 15 20:02:23.508142 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 517/1105] 10.222.0.58 () {58 vars in 1406 bytes} [Thu Apr 15 20:02:23 2021] DELETE /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0/os-volume_attachments/a0b4a375-3f23-448e-b057-271e8593a3b0 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:02:25.099038 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e60ddb42-a0ec-43d0-8f87-c2d1bf814aec tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:25.099631 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e60ddb42-a0ec-43d0-8f87-c2d1bf814aec tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:02:25.107455 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e60ddb42-a0ec-43d0-8f87-c2d1bf814aec tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:25.107972 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e60ddb42-a0ec-43d0-8f87-c2d1bf814aec tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:25.108812 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e60ddb42-a0ec-43d0-8f87-c2d1bf814aec tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:25.109310 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e60ddb42-a0ec-43d0-8f87-c2d1bf814aec tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:25.175536 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e60ddb42-a0ec-43d0-8f87-c2d1bf814aec tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Going to try to terminate instance {{(pid=99511) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 15 20:02:25.293228 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e60ddb42-a0ec-43d0-8f87-c2d1bf814aec tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "DELETE /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0" status: 204 len: 0 microversion: 2.1 time: 0.198453 Apr 15 20:02:25.294119 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 589/1106] 10.222.0.58 () {58 vars in 1229 bytes} [Thu Apr 15 20:02:25 2021] DELETE /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 15 20:02:25.304498 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-3d7f3cba-e617-419a-8277-31447a8f529c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:25.305274 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-3d7f3cba-e617-419a-8277-31447a8f529c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:02:25.313284 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3d7f3cba-e617-419a-8277-31447a8f529c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:25.313795 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3d7f3cba-e617-419a-8277-31447a8f529c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:25.314671 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3d7f3cba-e617-419a-8277-31447a8f529c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:25.315166 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3d7f3cba-e617-419a-8277-31447a8f529c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:25.531177 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3d7f3cba-e617-419a-8277-31447a8f529c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:02:25.540568 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-3d7f3cba-e617-419a-8277-31447a8f529c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0" status: 200 len: 1671 microversion: 2.1 time: 0.241724 Apr 15 20:02:25.541199 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 518/1107] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:02:25 2021] GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0 => generated 1671 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:02:26.235061 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-058af17d-700c-4a85-9383-3a5ccfc9e310 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:26.236411 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-058af17d-700c-4a85-9383-3a5ccfc9e310 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:02:26.246329 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-058af17d-700c-4a85-9383-3a5ccfc9e310 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:26.246838 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-058af17d-700c-4a85-9383-3a5ccfc9e310 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:26.247719 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-058af17d-700c-4a85-9383-3a5ccfc9e310 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:26.248203 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-058af17d-700c-4a85-9383-3a5ccfc9e310 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:26.300746 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-73949095-1d69-4d2d-a687-3c704d467cd3 req-d4afe0bc-5598-4dac-bcea-7b538ff8f0f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c241efcb-ba90-43dd-a6c3-393b77086172", "tag": "32a87087-67a6-454d-8830-c295f0d8e889"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:02:26.302510 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:02:26.302510 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:02:26.311573 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-73949095-1d69-4d2d-a687-3c704d467cd3 req-d4afe0bc-5598-4dac-bcea-7b538ff8f0f1 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:26.312079 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-73949095-1d69-4d2d-a687-3c704d467cd3 req-d4afe0bc-5598-4dac-bcea-7b538ff8f0f1 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:26.315580 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-058af17d-700c-4a85-9383-3a5ccfc9e310 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Going to try to terminate instance {{(pid=99511) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 15 20:02:26.329501 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-73949095-1d69-4d2d-a687-3c704d467cd3 req-d4afe0bc-5598-4dac-bcea-7b538ff8f0f1 service nova] Creating event network-changed:32a87087-67a6-454d-8830-c295f0d8e889 for instance c241efcb-ba90-43dd-a6c3-393b77086172 on hv-cinder-78638 Apr 15 20:02:26.335165 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-73949095-1d69-4d2d-a687-3c704d467cd3 req-d4afe0bc-5598-4dac-bcea-7b538ff8f0f1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100236 Apr 15 20:02:26.335855 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 519/1108] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:02:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 15 20:02:26.434677 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-058af17d-700c-4a85-9383-3a5ccfc9e310 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 204 len: 0 microversion: 2.1 time: 0.203886 Apr 15 20:02:26.436359 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 590/1109] 10.222.0.58 () {58 vars in 1229 bytes} [Thu Apr 15 20:02:26 2021] DELETE /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 15 20:02:26.446011 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-1322c53e-4c4f-4d93-8af7-37cce01d33e5 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:26.447195 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-1322c53e-4c4f-4d93-8af7-37cce01d33e5 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:02:26.455602 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1322c53e-4c4f-4d93-8af7-37cce01d33e5 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:26.456202 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1322c53e-4c4f-4d93-8af7-37cce01d33e5 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:26.457316 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1322c53e-4c4f-4d93-8af7-37cce01d33e5 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:26.457891 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1322c53e-4c4f-4d93-8af7-37cce01d33e5 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:26.561115 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b12a34a1-b34a-4b89-9ee9-3ee26819508f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:26.562327 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b12a34a1-b34a-4b89-9ee9-3ee26819508f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:02:26.571674 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b12a34a1-b34a-4b89-9ee9-3ee26819508f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:26.572581 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b12a34a1-b34a-4b89-9ee9-3ee26819508f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:26.573675 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b12a34a1-b34a-4b89-9ee9-3ee26819508f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:26.574394 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b12a34a1-b34a-4b89-9ee9-3ee26819508f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:26.737409 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-1322c53e-4c4f-4d93-8af7-37cce01d33e5 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:02:26.746658 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-1322c53e-4c4f-4d93-8af7-37cce01d33e5 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1569 microversion: 2.1 time: 0.305029 Apr 15 20:02:26.747693 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 520/1110] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:02:26 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1569 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 20:02:26.847969 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b12a34a1-b34a-4b89-9ee9-3ee26819508f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:02:26.857636 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b12a34a1-b34a-4b89-9ee9-3ee26819508f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0" status: 200 len: 1671 microversion: 2.1 time: 0.301212 Apr 15 20:02:26.858556 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 591/1111] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:02:26 2021] GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0 => generated 1671 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:02:27.768149 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e96fcf18-ab53-4caa-a555-638cbd0398e5 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:27.768817 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e96fcf18-ab53-4caa-a555-638cbd0398e5 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:02:27.777725 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e96fcf18-ab53-4caa-a555-638cbd0398e5 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:27.778242 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e96fcf18-ab53-4caa-a555-638cbd0398e5 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:27.779082 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e96fcf18-ab53-4caa-a555-638cbd0398e5 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:27.779596 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e96fcf18-ab53-4caa-a555-638cbd0398e5 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:27.876000 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b6b0d35a-f634-40c9-8462-a1acf4eccdb2 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:27.877254 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b6b0d35a-f634-40c9-8462-a1acf4eccdb2 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:02:27.889067 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b6b0d35a-f634-40c9-8462-a1acf4eccdb2 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:27.889581 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b6b0d35a-f634-40c9-8462-a1acf4eccdb2 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:27.891005 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b6b0d35a-f634-40c9-8462-a1acf4eccdb2 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:27.891712 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b6b0d35a-f634-40c9-8462-a1acf4eccdb2 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:28.422573 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-e96fcf18-ab53-4caa-a555-638cbd0398e5 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:02:28.431755 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e96fcf18-ab53-4caa-a555-638cbd0398e5 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1450 microversion: 2.1 time: 0.670168 Apr 15 20:02:28.442387 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 521/1112] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:02:27 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1450 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:02:28.681623 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b6b0d35a-f634-40c9-8462-a1acf4eccdb2 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:02:28.691152 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b6b0d35a-f634-40c9-8462-a1acf4eccdb2 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0" status: 200 len: 1671 microversion: 2.1 time: 0.819100 Apr 15 20:02:28.692573 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 592/1113] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:02:27 2021] GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0 => generated 1671 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:02:29.186326 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-93bb68f5-7884-432f-a547-ae35f6ef42ec req-ef1f41aa-d066-4ee6-962a-1416bef529ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c241efcb-ba90-43dd-a6c3-393b77086172", "name": "network-vif-deleted", "tag": "32a87087-67a6-454d-8830-c295f0d8e889"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:02:29.188376 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:02:29.188376 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:02:29.198661 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-93bb68f5-7884-432f-a547-ae35f6ef42ec req-ef1f41aa-d066-4ee6-962a-1416bef529ed service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:29.199536 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-93bb68f5-7884-432f-a547-ae35f6ef42ec req-ef1f41aa-d066-4ee6-962a-1416bef529ed service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:29.217883 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-93bb68f5-7884-432f-a547-ae35f6ef42ec req-ef1f41aa-d066-4ee6-962a-1416bef529ed service nova] Creating event network-vif-deleted:32a87087-67a6-454d-8830-c295f0d8e889 for instance c241efcb-ba90-43dd-a6c3-393b77086172 on hv-cinder-78638 Apr 15 20:02:29.223248 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-93bb68f5-7884-432f-a547-ae35f6ef42ec req-ef1f41aa-d066-4ee6-962a-1416bef529ed service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041229 Apr 15 20:02:29.223934 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 522/1114] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:02:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:02:29.450610 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-dffbe0f0-5e4c-4bac-8605-c82fb5db377e tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:29.451627 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-dffbe0f0-5e4c-4bac-8605-c82fb5db377e tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:02:29.460170 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dffbe0f0-5e4c-4bac-8605-c82fb5db377e tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:29.460922 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dffbe0f0-5e4c-4bac-8605-c82fb5db377e tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:29.461939 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dffbe0f0-5e4c-4bac-8605-c82fb5db377e tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:29.462580 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dffbe0f0-5e4c-4bac-8605-c82fb5db377e tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:29.580915 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-37295fa4-a504-4c61-aea6-3abbd7910453 req-3ce01f02-ba8b-426a-98af-ac318e28726d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60b02d1c-8109-44c4-a030-a1edb69e37e0", "name": "network-vif-deleted", "tag": "cbdc0e24-2f5d-4fa7-a4ea-f097683823d9"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:02:29.582743 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:02:29.582743 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:02:29.599743 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-37295fa4-a504-4c61-aea6-3abbd7910453 req-3ce01f02-ba8b-426a-98af-ac318e28726d service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:29.603135 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-37295fa4-a504-4c61-aea6-3abbd7910453 req-3ce01f02-ba8b-426a-98af-ac318e28726d service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:29.646392 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-37295fa4-a504-4c61-aea6-3abbd7910453 req-3ce01f02-ba8b-426a-98af-ac318e28726d service nova] Creating event network-vif-deleted:cbdc0e24-2f5d-4fa7-a4ea-f097683823d9 for instance 60b02d1c-8109-44c4-a030-a1edb69e37e0 on hv-cinder-78638 Apr 15 20:02:29.657203 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-dffbe0f0-5e4c-4bac-8605-c82fb5db377e tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8698c520674549bfbecfa31cd2acb852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9208f04bcf45e4a5d2ef86825620d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:02:29.658389 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-37295fa4-a504-4c61-aea6-3abbd7910453 req-3ce01f02-ba8b-426a-98af-ac318e28726d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180716 Apr 15 20:02:29.659343 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 523/1115] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:02:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 15 20:02:29.673209 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-dffbe0f0-5e4c-4bac-8605-c82fb5db377e tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 200 len: 1220 microversion: 2.1 time: 0.226555 Apr 15 20:02:29.674706 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 593/1116] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:02:29 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 1220 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:02:29.713333 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-88532c43-d800-4b0f-98b8-fcb39fcb26e3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:29.715078 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-88532c43-d800-4b0f-98b8-fcb39fcb26e3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:02:29.729042 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-88532c43-d800-4b0f-98b8-fcb39fcb26e3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:29.729764 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-88532c43-d800-4b0f-98b8-fcb39fcb26e3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:29.730775 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-88532c43-d800-4b0f-98b8-fcb39fcb26e3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:29.731384 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-88532c43-d800-4b0f-98b8-fcb39fcb26e3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:29.814437 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-88532c43-d800-4b0f-98b8-fcb39fcb26e3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:29.814947 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-88532c43-d800-4b0f-98b8-fcb39fcb26e3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:29.815555 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.objects.instance [None req-88532c43-d800-4b0f-98b8-fcb39fcb26e3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lazy-loading 'fault' on Instance uuid 60b02d1c-8109-44c4-a030-a1edb69e37e0 {{(pid=99512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 15 20:02:29.899871 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-88532c43-d800-4b0f-98b8-fcb39fcb26e3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94a8e6666654a7f969179a50453efac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba23e5df9154ee5b97b92e3f9090983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:02:29.909883 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-88532c43-d800-4b0f-98b8-fcb39fcb26e3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0" status: 200 len: 1327 microversion: 2.1 time: 0.204263 Apr 15 20:02:29.910482 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 524/1117] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:02:29 2021] GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0 => generated 1327 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:02:30.692943 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-68c52c2b-9712-42c1-b30d-19562a18cbd7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:30.693618 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-68c52c2b-9712-42c1-b30d-19562a18cbd7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] [instance: c241efcb-ba90-43dd-a6c3-393b77086172] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:02:30.701717 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-68c52c2b-9712-42c1-b30d-19562a18cbd7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:30.702246 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-68c52c2b-9712-42c1-b30d-19562a18cbd7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:30.703073 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-68c52c2b-9712-42c1-b30d-19562a18cbd7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:30.703591 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-68c52c2b-9712-42c1-b30d-19562a18cbd7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:30.758504 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-68c52c2b-9712-42c1-b30d-19562a18cbd7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] HTTP exception thrown: Instance c241efcb-ba90-43dd-a6c3-393b77086172 could not be found. Apr 15 20:02:30.759186 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-68c52c2b-9712-42c1-b30d-19562a18cbd7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Returning 404 to user: Instance c241efcb-ba90-43dd-a6c3-393b77086172 could not be found. {{(pid=99511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 20:02:30.760124 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-68c52c2b-9712-42c1-b30d-19562a18cbd7 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172" status: 404 len: 111 microversion: 2.1 time: 0.071912 Apr 15 20:02:30.760745 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 594/1118] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:02:30 2021] GET /compute/v2.1/servers/c241efcb-ba90-43dd-a6c3-393b77086172 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 15 20:02:30.930162 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-bbbed358-7486-4ead-a091-77e8772a02de tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:30.930835 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-bbbed358-7486-4ead-a091-77e8772a02de tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:02:30.938863 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bbbed358-7486-4ead-a091-77e8772a02de tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:30.939958 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bbbed358-7486-4ead-a091-77e8772a02de tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:30.940803 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bbbed358-7486-4ead-a091-77e8772a02de tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:30.941292 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bbbed358-7486-4ead-a091-77e8772a02de tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:30.969051 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-85549f5a-921a-418d-a903-e7251f5f5c70 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] Calling method '.version_select at 0x7f18d817d8c8>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:30.988315 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-85549f5a-921a-418d-a903-e7251f5f5c70 tempest-TestShelveInstance-1598611905 tempest-TestShelveInstance-1598611905-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2030024038" status: 202 len: 0 microversion: 2.1 time: 0.024518 Apr 15 20:02:30.992290 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 595/1119] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Apr 15 20:02:30 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2030024038 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:02:30.999480 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-bbbed358-7486-4ead-a091-77e8772a02de tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] HTTP exception thrown: Instance 60b02d1c-8109-44c4-a030-a1edb69e37e0 could not be found. Apr 15 20:02:30.999480 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-bbbed358-7486-4ead-a091-77e8772a02de tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Returning 404 to user: Instance 60b02d1c-8109-44c4-a030-a1edb69e37e0 could not be found. {{(pid=99512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 20:02:30.999926 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-bbbed358-7486-4ead-a091-77e8772a02de tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0" status: 404 len: 111 microversion: 2.1 time: 0.074879 Apr 15 20:02:31.004315 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 525/1120] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:02:30 2021] GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 15 20:02:31.011853 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7874118a-508e-4a88-9371-8444f886fd99 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '.version_select at 0x7f18d3779268>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:31.038558 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7874118a-508e-4a88-9371-8444f886fd99 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2060569496" status: 202 len: 0 microversion: 2.1 time: 0.032509 Apr 15 20:02:31.039558 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 596/1121] 10.222.0.58 () {58 vars in 1211 bytes} [Thu Apr 15 20:02:31 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2060569496 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:02:34.703530 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-2d4d55eb-d3d7-493e-a578-5b7fba5963a3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:34.704064 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-2d4d55eb-d3d7-493e-a578-5b7fba5963a3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:02:34.713390 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2d4d55eb-d3d7-493e-a578-5b7fba5963a3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:34.713910 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2d4d55eb-d3d7-493e-a578-5b7fba5963a3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:34.715084 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2d4d55eb-d3d7-493e-a578-5b7fba5963a3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:34.715628 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2d4d55eb-d3d7-493e-a578-5b7fba5963a3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:34.771076 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-2d4d55eb-d3d7-493e-a578-5b7fba5963a3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] HTTP exception thrown: Instance 60b02d1c-8109-44c4-a030-a1edb69e37e0 could not be found. Apr 15 20:02:34.771778 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-2d4d55eb-d3d7-493e-a578-5b7fba5963a3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Returning 404 to user: Instance 60b02d1c-8109-44c4-a030-a1edb69e37e0 could not be found. {{(pid=99512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 20:02:34.772805 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-2d4d55eb-d3d7-493e-a578-5b7fba5963a3 tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "DELETE /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0" status: 404 len: 111 microversion: 2.1 time: 0.073216 Apr 15 20:02:34.773727 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 526/1122] 10.222.0.58 () {58 vars in 1229 bytes} [Thu Apr 15 20:02:34 2021] DELETE /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 15 20:02:34.781899 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a443ad25-c534-4fba-b7dc-5c575976ae6c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:34.782625 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a443ad25-c534-4fba-b7dc-5c575976ae6c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 60b02d1c-8109-44c4-a030-a1edb69e37e0] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:02:34.792307 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a443ad25-c534-4fba-b7dc-5c575976ae6c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:34.792825 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a443ad25-c534-4fba-b7dc-5c575976ae6c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:34.793689 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a443ad25-c534-4fba-b7dc-5c575976ae6c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:34.794189 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a443ad25-c534-4fba-b7dc-5c575976ae6c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:34.852614 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-a443ad25-c534-4fba-b7dc-5c575976ae6c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] HTTP exception thrown: Instance 60b02d1c-8109-44c4-a030-a1edb69e37e0 could not be found. Apr 15 20:02:34.853407 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a443ad25-c534-4fba-b7dc-5c575976ae6c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Returning 404 to user: Instance 60b02d1c-8109-44c4-a030-a1edb69e37e0 could not be found. {{(pid=99511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 20:02:34.854399 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a443ad25-c534-4fba-b7dc-5c575976ae6c tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0" status: 404 len: 111 microversion: 2.1 time: 0.076577 Apr 15 20:02:34.855112 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 597/1123] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:02:34 2021] GET /compute/v2.1/servers/60b02d1c-8109-44c4-a030-a1edb69e37e0 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 15 20:02:36.122639 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-916dcff3-d483-41aa-b423-0b49a6f12f6f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:36.123169 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-916dcff3-d483-41aa-b423-0b49a6f12f6f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:02:36.131608 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-916dcff3-d483-41aa-b423-0b49a6f12f6f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:36.132089 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-916dcff3-d483-41aa-b423-0b49a6f12f6f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:36.133151 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-916dcff3-d483-41aa-b423-0b49a6f12f6f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:36.133639 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-916dcff3-d483-41aa-b423-0b49a6f12f6f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:36.189706 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-916dcff3-d483-41aa-b423-0b49a6f12f6f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] HTTP exception thrown: Instance 271550cc-6d60-4503-9d82-cbf32efbd5d9 could not be found. Apr 15 20:02:36.190372 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-916dcff3-d483-41aa-b423-0b49a6f12f6f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Returning 404 to user: Instance 271550cc-6d60-4503-9d82-cbf32efbd5d9 could not be found. {{(pid=99512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 20:02:36.191307 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-916dcff3-d483-41aa-b423-0b49a6f12f6f tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "DELETE /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 404 len: 111 microversion: 2.1 time: 0.073132 Apr 15 20:02:36.192087 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 527/1124] 10.222.0.58 () {58 vars in 1229 bytes} [Thu Apr 15 20:02:36 2021] DELETE /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 15 20:02:36.200423 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-dd2ddc73-7427-45c1-a628-f28d08ea16cb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:36.201215 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-dd2ddc73-7427-45c1-a628-f28d08ea16cb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] [instance: 271550cc-6d60-4503-9d82-cbf32efbd5d9] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:02:36.210097 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dd2ddc73-7427-45c1-a628-f28d08ea16cb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:36.210684 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dd2ddc73-7427-45c1-a628-f28d08ea16cb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:36.211640 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dd2ddc73-7427-45c1-a628-f28d08ea16cb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:36.212353 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dd2ddc73-7427-45c1-a628-f28d08ea16cb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:36.269592 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-dd2ddc73-7427-45c1-a628-f28d08ea16cb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] HTTP exception thrown: Instance 271550cc-6d60-4503-9d82-cbf32efbd5d9 could not be found. Apr 15 20:02:36.270282 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-dd2ddc73-7427-45c1-a628-f28d08ea16cb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] Returning 404 to user: Instance 271550cc-6d60-4503-9d82-cbf32efbd5d9 could not be found. {{(pid=99511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 20:02:36.271402 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-dd2ddc73-7427-45c1-a628-f28d08ea16cb tempest-AttachVolumeTestJSON-1867735879 tempest-AttachVolumeTestJSON-1867735879-project] 10.222.0.58 "GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9" status: 404 len: 111 microversion: 2.1 time: 0.075127 Apr 15 20:02:36.272232 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 598/1125] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:02:36 2021] GET /compute/v2.1/servers/271550cc-6d60-4503-9d82-cbf32efbd5d9 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 15 20:02:44.932475 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-30105f7e-3bc0-4434-bc5b-32a59ef7449f tempest-VolumesGetTestJSON-801625981 tempest-VolumesGetTestJSON-801625981-project] Action: 'create', calling method: .version_select at 0x7f18d81ad9d8>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1615435272", "metadata": {"Type": "work"}}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:02:45.390492 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-30105f7e-3bc0-4434-bc5b-32a59ef7449f tempest-VolumesGetTestJSON-801625981 tempest-VolumesGetTestJSON-801625981-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.588836 Apr 15 20:02:45.391300 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 528/1126] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Apr 15 20:02:44 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 590 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 15 20:02:45.402970 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7c3898ee-e933-465e-951c-976e47140422 tempest-VolumesGetTestJSON-801625981 tempest-VolumesGetTestJSON-801625981-project] Calling method '.version_select at 0x7f18d8b2c840>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:45.503757 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7c3898ee-e933-465e-951c-976e47140422 tempest-VolumesGetTestJSON-801625981 tempest-VolumesGetTestJSON-801625981-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/06af2303-6934-4483-9fa6-93f4722a68a1" status: 200 len: 353 microversion: 2.1 time: 0.104540 Apr 15 20:02:45.504477 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 599/1127] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Apr 15 20:02:45 2021] GET /compute/v2.1/os-volumes/06af2303-6934-4483-9fa6-93f4722a68a1 => generated 353 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:02:46.516992 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ff7a2caf-c162-4bf1-809c-9251706465cf tempest-VolumesGetTestJSON-801625981 tempest-VolumesGetTestJSON-801625981-project] Calling method '.version_select at 0x7f18d81ad7b8>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:46.617862 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ff7a2caf-c162-4bf1-809c-9251706465cf tempest-VolumesGetTestJSON-801625981 tempest-VolumesGetTestJSON-801625981-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/06af2303-6934-4483-9fa6-93f4722a68a1" status: 200 len: 354 microversion: 2.1 time: 0.104674 Apr 15 20:02:46.618485 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 529/1128] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Apr 15 20:02:46 2021] GET /compute/v2.1/os-volumes/06af2303-6934-4483-9fa6-93f4722a68a1 => generated 354 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:02:46.630579 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6d7b3492-0f55-45c5-93c7-c0d8c5278f88 tempest-VolumesGetTestJSON-801625981 tempest-VolumesGetTestJSON-801625981-project] Calling method '.version_select at 0x7f18d3779620>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:46.734301 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6d7b3492-0f55-45c5-93c7-c0d8c5278f88 tempest-VolumesGetTestJSON-801625981 tempest-VolumesGetTestJSON-801625981-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/06af2303-6934-4483-9fa6-93f4722a68a1" status: 200 len: 354 microversion: 2.1 time: 0.107962 Apr 15 20:02:46.734979 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 600/1129] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Apr 15 20:02:46 2021] GET /compute/v2.1/os-volumes/06af2303-6934-4483-9fa6-93f4722a68a1 => generated 354 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:02:46.754832 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-0ef7d079-9954-4d71-8026-b7d9c6331ed0 tempest-VolumesGetTestJSON-801625981 tempest-VolumesGetTestJSON-801625981-project] Calling method '.version_select at 0x7f18d81adae8>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:46.853430 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-0ef7d079-9954-4d71-8026-b7d9c6331ed0 tempest-VolumesGetTestJSON-801625981 tempest-VolumesGetTestJSON-801625981-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/06af2303-6934-4483-9fa6-93f4722a68a1" status: 202 len: 0 microversion: 2.1 time: 0.102907 Apr 15 20:02:46.854046 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 530/1130] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Apr 15 20:02:46 2021] DELETE /compute/v2.1/os-volumes/06af2303-6934-4483-9fa6-93f4722a68a1 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:02:46.863350 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ff6f0dc5-3839-4f07-a014-f1eb531108a1 tempest-VolumesGetTestJSON-801625981 tempest-VolumesGetTestJSON-801625981-project] Calling method '.version_select at 0x7f18d3779d08>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:46.962068 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ff6f0dc5-3839-4f07-a014-f1eb531108a1 tempest-VolumesGetTestJSON-801625981 tempest-VolumesGetTestJSON-801625981-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/06af2303-6934-4483-9fa6-93f4722a68a1" status: 200 len: 353 microversion: 2.1 time: 0.103529 Apr 15 20:02:46.962694 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 601/1131] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Apr 15 20:02:46 2021] GET /compute/v2.1/os-volumes/06af2303-6934-4483-9fa6-93f4722a68a1 => generated 353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:02:47.977230 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a846d458-6022-44d3-9c04-d4eee28ae863 tempest-VolumesGetTestJSON-801625981 tempest-VolumesGetTestJSON-801625981-project] Calling method '.version_select at 0x7f18d81adc80>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:48.056351 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-a846d458-6022-44d3-9c04-d4eee28ae863 tempest-VolumesGetTestJSON-801625981 tempest-VolumesGetTestJSON-801625981-project] HTTP exception thrown: Volume 06af2303-6934-4483-9fa6-93f4722a68a1 could not be found. Apr 15 20:02:48.057325 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a846d458-6022-44d3-9c04-d4eee28ae863 tempest-VolumesGetTestJSON-801625981 tempest-VolumesGetTestJSON-801625981-project] Returning 404 to user: Volume 06af2303-6934-4483-9fa6-93f4722a68a1 could not be found. {{(pid=99512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 20:02:48.058362 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a846d458-6022-44d3-9c04-d4eee28ae863 tempest-VolumesGetTestJSON-801625981 tempest-VolumesGetTestJSON-801625981-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/06af2303-6934-4483-9fa6-93f4722a68a1" status: 404 len: 109 microversion: 2.1 time: 0.086179 Apr 15 20:02:48.059496 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 531/1132] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Apr 15 20:02:47 2021] GET /compute/v2.1/os-volumes/06af2303-6934-4483-9fa6-93f4722a68a1 => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 15 20:02:48.350705 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a4674208-59b2-4cc1-aaeb-306575f7c203 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:48.351592 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a4674208-59b2-4cc1-aaeb-306575f7c203 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:02:48.360855 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a4674208-59b2-4cc1-aaeb-306575f7c203 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:48.361897 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a4674208-59b2-4cc1-aaeb-306575f7c203 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:48.362747 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a4674208-59b2-4cc1-aaeb-306575f7c203 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:48.363430 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a4674208-59b2-4cc1-aaeb-306575f7c203 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:48.438056 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a4674208-59b2-4cc1-aaeb-306575f7c203 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Going to try to terminate instance {{(pid=99511) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 15 20:02:48.584623 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a4674208-59b2-4cc1-aaeb-306575f7c203 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "DELETE /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 204 len: 0 microversion: 2.20 time: 0.238760 Apr 15 20:02:48.585811 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 602/1133] 10.222.0.58 () {60 vars in 1270 bytes} [Thu Apr 15 20:02:48 2021] DELETE /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 15 20:02:48.594916 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-bbc90934-7d6e-4c8c-a52c-812e72617011 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:48.595928 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-bbc90934-7d6e-4c8c-a52c-812e72617011 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:02:48.611673 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bbc90934-7d6e-4c8c-a52c-812e72617011 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:48.612943 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bbc90934-7d6e-4c8c-a52c-812e72617011 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:48.614099 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bbc90934-7d6e-4c8c-a52c-812e72617011 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:48.614795 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bbc90934-7d6e-4c8c-a52c-812e72617011 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:49.211117 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-bbc90934-7d6e-4c8c-a52c-812e72617011 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:02:49.224692 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-bbc90934-7d6e-4c8c-a52c-812e72617011 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:02:49.227267 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-bbc90934-7d6e-4c8c-a52c-812e72617011 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:02:49.229514 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-bbc90934-7d6e-4c8c-a52c-812e72617011 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1724 microversion: 2.20 time: 0.638249 Apr 15 20:02:49.230983 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 532/1134] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:02:48 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1724 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 20:02:50.250267 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-5b72f21a-3d49-41ea-8736-2a5c935e4880 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:50.251787 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-5b72f21a-3d49-41ea-8736-2a5c935e4880 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:02:50.259707 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5b72f21a-3d49-41ea-8736-2a5c935e4880 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:50.260334 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5b72f21a-3d49-41ea-8736-2a5c935e4880 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:50.261283 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5b72f21a-3d49-41ea-8736-2a5c935e4880 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:50.261880 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5b72f21a-3d49-41ea-8736-2a5c935e4880 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:51.024765 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-5b72f21a-3d49-41ea-8736-2a5c935e4880 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:02:51.037451 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-5b72f21a-3d49-41ea-8736-2a5c935e4880 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:02:51.039848 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-5b72f21a-3d49-41ea-8736-2a5c935e4880 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:02:51.041836 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-5b72f21a-3d49-41ea-8736-2a5c935e4880 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1724 microversion: 2.20 time: 0.795557 Apr 15 20:02:51.042705 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 603/1135] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:02:50 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1724 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 20:02:52.062072 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-4736d54f-4ebb-48be-b77b-172ee5b9e069 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:52.063805 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-4736d54f-4ebb-48be-b77b-172ee5b9e069 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:02:52.087253 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4736d54f-4ebb-48be-b77b-172ee5b9e069 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:52.090852 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4736d54f-4ebb-48be-b77b-172ee5b9e069 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:52.092488 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4736d54f-4ebb-48be-b77b-172ee5b9e069 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:52.094253 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4736d54f-4ebb-48be-b77b-172ee5b9e069 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:52.380353 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-4736d54f-4ebb-48be-b77b-172ee5b9e069 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:02:52.394129 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-4736d54f-4ebb-48be-b77b-172ee5b9e069 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:02:52.397917 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-4736d54f-4ebb-48be-b77b-172ee5b9e069 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:02:52.399154 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-4736d54f-4ebb-48be-b77b-172ee5b9e069 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1656 microversion: 2.20 time: 0.341120 Apr 15 20:02:52.399817 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 533/1136] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:02:52 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1656 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 20:02:53.011775 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-f53f4901-f1f2-4bd0-9216-a1e452c7fbc8 req-fca97081-d1b7-4a8d-b0f8-5878b5ebac40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aac757a2-25b5-4006-abd0-4b3aa0b5ae08", "name": "network-vif-deleted", "tag": "094b251a-1524-4ff8-b586-45456b2a7026"}]} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:02:53.014052 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:02:53.014052 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:02:53.034166 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-f53f4901-f1f2-4bd0-9216-a1e452c7fbc8 req-fca97081-d1b7-4a8d-b0f8-5878b5ebac40 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:53.034652 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-f53f4901-f1f2-4bd0-9216-a1e452c7fbc8 req-fca97081-d1b7-4a8d-b0f8-5878b5ebac40 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:53.070143 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-f53f4901-f1f2-4bd0-9216-a1e452c7fbc8 req-fca97081-d1b7-4a8d-b0f8-5878b5ebac40 service nova] Creating event network-vif-deleted:094b251a-1524-4ff8-b586-45456b2a7026 for instance aac757a2-25b5-4006-abd0-4b3aa0b5ae08 on hv-cinder-78638 Apr 15 20:02:53.093483 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-f53f4901-f1f2-4bd0-9216-a1e452c7fbc8 req-fca97081-d1b7-4a8d-b0f8-5878b5ebac40 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085862 Apr 15 20:02:53.094411 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 604/1137] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:02:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:02:53.418405 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-3cd1fe31-3fdf-4451-be20-9e8f4559fe0e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:53.419069 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-3cd1fe31-3fdf-4451-be20-9e8f4559fe0e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:02:53.433343 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3cd1fe31-3fdf-4451-be20-9e8f4559fe0e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:53.434130 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3cd1fe31-3fdf-4451-be20-9e8f4559fe0e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:53.436316 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3cd1fe31-3fdf-4451-be20-9e8f4559fe0e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:53.436985 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3cd1fe31-3fdf-4451-be20-9e8f4559fe0e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:53.576073 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3cd1fe31-3fdf-4451-be20-9e8f4559fe0e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:53.576691 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3cd1fe31-3fdf-4451-be20-9e8f4559fe0e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:53.577257 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.objects.instance [None req-3cd1fe31-3fdf-4451-be20-9e8f4559fe0e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lazy-loading 'fault' on Instance uuid aac757a2-25b5-4006-abd0-4b3aa0b5ae08 {{(pid=99512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 15 20:02:53.750541 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3cd1fe31-3fdf-4451-be20-9e8f4559fe0e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:02:53.762221 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3cd1fe31-3fdf-4451-be20-9e8f4559fe0e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:02:53.764219 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3cd1fe31-3fdf-4451-be20-9e8f4559fe0e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd70e02f8a6aa46c19265378d00f98895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e9c7381e93406886cc6f3577690f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:02:53.765851 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-3cd1fe31-3fdf-4451-be20-9e8f4559fe0e tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 200 len: 1371 microversion: 2.20 time: 0.351491 Apr 15 20:02:53.767007 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 534/1138] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:02:53 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 1371 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 15 20:02:54.787466 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-aad04532-bfcf-4c68-a52d-40b6a7221d0b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:54.788038 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-aad04532-bfcf-4c68-a52d-40b6a7221d0b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:02:54.802093 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-aad04532-bfcf-4c68-a52d-40b6a7221d0b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:54.802587 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-aad04532-bfcf-4c68-a52d-40b6a7221d0b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:54.806199 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-aad04532-bfcf-4c68-a52d-40b6a7221d0b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:54.806702 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-aad04532-bfcf-4c68-a52d-40b6a7221d0b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:54.912003 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-aad04532-bfcf-4c68-a52d-40b6a7221d0b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] HTTP exception thrown: Instance aac757a2-25b5-4006-abd0-4b3aa0b5ae08 could not be found. Apr 15 20:02:54.912656 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-aad04532-bfcf-4c68-a52d-40b6a7221d0b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Returning 404 to user: Instance aac757a2-25b5-4006-abd0-4b3aa0b5ae08 could not be found. {{(pid=99511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 20:02:54.913714 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-aad04532-bfcf-4c68-a52d-40b6a7221d0b tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 404 len: 111 microversion: 2.20 time: 0.132152 Apr 15 20:02:54.914313 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 605/1139] 10.222.0.58 () {60 vars in 1267 bytes} [Thu Apr 15 20:02:54 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 15 20:02:54.924356 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-dc0965bc-8c0e-4d2d-b2a6-cee0383fe3c5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '.version_select at 0x7f18d36e9488>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:54.951684 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-dc0965bc-8c0e-4d2d-b2a6-cee0383fe3c5 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1394026836" status: 204 len: 0 microversion: 2.20 time: 0.032322 Apr 15 20:02:54.952563 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 535/1140] 10.222.0.58 () {60 vars in 1252 bytes} [Thu Apr 15 20:02:54 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1394026836 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 15 20:02:58.367155 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a8a44570-01d2-469a-9af7-29e87324db65 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:58.368590 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a8a44570-01d2-469a-9af7-29e87324db65 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:02:58.378376 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a8a44570-01d2-469a-9af7-29e87324db65 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:58.379125 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a8a44570-01d2-469a-9af7-29e87324db65 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:58.380228 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a8a44570-01d2-469a-9af7-29e87324db65 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:58.381050 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a8a44570-01d2-469a-9af7-29e87324db65 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:58.453680 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-a8a44570-01d2-469a-9af7-29e87324db65 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] HTTP exception thrown: Instance aac757a2-25b5-4006-abd0-4b3aa0b5ae08 could not be found. Apr 15 20:02:58.455774 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a8a44570-01d2-469a-9af7-29e87324db65 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Returning 404 to user: Instance aac757a2-25b5-4006-abd0-4b3aa0b5ae08 could not be found. {{(pid=99511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 20:02:58.456690 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a8a44570-01d2-469a-9af7-29e87324db65 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "DELETE /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 404 len: 111 microversion: 2.1 time: 0.094234 Apr 15 20:02:58.457828 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 606/1141] 10.222.0.58 () {58 vars in 1229 bytes} [Thu Apr 15 20:02:58 2021] DELETE /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 15 20:02:58.471095 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-bf14bf87-dcfb-4612-b3ab-2db6a75f15b0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:58.472222 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-bf14bf87-dcfb-4612-b3ab-2db6a75f15b0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: aac757a2-25b5-4006-abd0-4b3aa0b5ae08] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:02:58.481538 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bf14bf87-dcfb-4612-b3ab-2db6a75f15b0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:58.482409 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bf14bf87-dcfb-4612-b3ab-2db6a75f15b0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:58.483904 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bf14bf87-dcfb-4612-b3ab-2db6a75f15b0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:58.484692 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bf14bf87-dcfb-4612-b3ab-2db6a75f15b0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:58.553540 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-bf14bf87-dcfb-4612-b3ab-2db6a75f15b0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] HTTP exception thrown: Instance aac757a2-25b5-4006-abd0-4b3aa0b5ae08 could not be found. Apr 15 20:02:58.554339 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-bf14bf87-dcfb-4612-b3ab-2db6a75f15b0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Returning 404 to user: Instance aac757a2-25b5-4006-abd0-4b3aa0b5ae08 could not be found. {{(pid=99512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 20:02:58.555258 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-bf14bf87-dcfb-4612-b3ab-2db6a75f15b0 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08" status: 404 len: 111 microversion: 2.1 time: 0.091003 Apr 15 20:02:58.572854 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 536/1142] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:02:58 2021] GET /compute/v2.1/servers/aac757a2-25b5-4006-abd0-4b3aa0b5ae08 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 15 20:02:59.921717 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-635947ca-0580-4269-b929-636b6d0c583a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:02:59.923499 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-635947ca-0580-4269-b929-636b6d0c583a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:02:59.935100 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-635947ca-0580-4269-b929-636b6d0c583a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:59.936178 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-635947ca-0580-4269-b929-636b6d0c583a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:02:59.937521 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-635947ca-0580-4269-b929-636b6d0c583a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:02:59.938970 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-635947ca-0580-4269-b929-636b6d0c583a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:00.012867 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-635947ca-0580-4269-b929-636b6d0c583a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] HTTP exception thrown: Instance 6c0ac4cf-7982-406b-a2f0-115ca5721a10 could not be found. Apr 15 20:03:00.013505 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-635947ca-0580-4269-b929-636b6d0c583a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Returning 404 to user: Instance 6c0ac4cf-7982-406b-a2f0-115ca5721a10 could not be found. {{(pid=99511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 20:03:00.014404 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-635947ca-0580-4269-b929-636b6d0c583a tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 404 len: 111 microversion: 2.1 time: 0.098035 Apr 15 20:03:00.015014 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 607/1143] 10.222.0.58 () {58 vars in 1229 bytes} [Thu Apr 15 20:02:59 2021] DELETE /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 15 20:03:00.023809 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9251bafb-856f-43b1-8036-0969c91d0988 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:00.024989 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9251bafb-856f-43b1-8036-0969c91d0988 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] [instance: 6c0ac4cf-7982-406b-a2f0-115ca5721a10] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:00.035010 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9251bafb-856f-43b1-8036-0969c91d0988 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:00.035885 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9251bafb-856f-43b1-8036-0969c91d0988 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:00.037307 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9251bafb-856f-43b1-8036-0969c91d0988 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:00.038006 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9251bafb-856f-43b1-8036-0969c91d0988 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:00.098043 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-9251bafb-856f-43b1-8036-0969c91d0988 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] HTTP exception thrown: Instance 6c0ac4cf-7982-406b-a2f0-115ca5721a10 could not be found. Apr 15 20:03:00.099063 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9251bafb-856f-43b1-8036-0969c91d0988 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] Returning 404 to user: Instance 6c0ac4cf-7982-406b-a2f0-115ca5721a10 could not be found. {{(pid=99512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 20:03:00.100200 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9251bafb-856f-43b1-8036-0969c91d0988 tempest-AttachVolumeShelveTestJSON-1464789136 tempest-AttachVolumeShelveTestJSON-1464789136-project] 10.222.0.58 "GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10" status: 404 len: 111 microversion: 2.1 time: 0.080695 Apr 15 20:03:00.101058 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 537/1144] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:00 2021] GET /compute/v2.1/servers/6c0ac4cf-7982-406b-a2f0-115ca5721a10 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 15 20:03:07.503171 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-07f752a7-74ba-4cf9-9bb8-587c99ef0697 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Action: 'create', calling method: .version_select at 0x7f18d34d7840>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-934650097"}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:03:07.532944 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-07f752a7-74ba-4cf9-9bb8-587c99ef0697 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Getting quotas for project 3e2a79620ac740e5a6e598a862a97631. Resources: {'key_pairs'} {{(pid=99511) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 15 20:03:07.537421 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-07f752a7-74ba-4cf9-9bb8-587c99ef0697 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Getting quotas for user 5c9d86e8f847470c8403807462b1f8cb and project 3e2a79620ac740e5a6e598a862a97631. Resources: {'key_pairs'} {{(pid=99511) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 15 20:03:07.723311 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-07f752a7-74ba-4cf9-9bb8-587c99ef0697 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Getting quotas for project 3e2a79620ac740e5a6e598a862a97631. Resources: {'key_pairs'} {{(pid=99511) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 15 20:03:07.728158 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-07f752a7-74ba-4cf9-9bb8-587c99ef0697 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Getting quotas for user 5c9d86e8f847470c8403807462b1f8cb and project 3e2a79620ac740e5a6e598a862a97631. Resources: {'key_pairs'} {{(pid=99511) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 15 20:03:07.750002 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-07f752a7-74ba-4cf9-9bb8-587c99ef0697 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.491079 Apr 15 20:03:07.752034 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 608/1145] 10.222.0.58 () {60 vars in 1148 bytes} [Thu Apr 15 20:03:07 2021] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:03:13.924143 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d57f148d-4faf-4d8d-9d48-9d98b95db634 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1506197281", "imageRef": "10d66d6e-f687-4228-93d1-67502c9b42e2", "flavorRef": "452", "networks": [{"uuid": "19b452bb-c309-496d-a8d9-d08c6427af14"}]}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:03:13.996698 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.network.neutron [None req-d57f148d-4faf-4d8d-9d48-9d98b95db634 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] validate_networks() for [('19b452bb-c309-496d-a8d9-d08c6427af14', None, None, None)] {{(pid=99512) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 15 20:03:14.534985 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-d57f148d-4faf-4d8d-9d48-9d98b95db634 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Flavor limits 0:0:0 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 15 20:03:14.535501 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-d57f148d-4faf-4d8d-9d48-9d98b95db634 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Image limits 0:0:0 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 15 20:03:14.536315 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-d57f148d-4faf-4d8d-9d48-9d98b95db634 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Flavor pref 0:0:0 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 15 20:03:14.536786 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-d57f148d-4faf-4d8d-9d48-9d98b95db634 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Image pref 0:0:0 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 15 20:03:14.537257 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-d57f148d-4faf-4d8d-9d48-9d98b95db634 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 15 20:03:14.546316 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d57f148d-4faf-4d8d-9d48-9d98b95db634 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:14.546997 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d57f148d-4faf-4d8d-9d48-9d98b95db634 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:14.548140 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d57f148d-4faf-4d8d-9d48-9d98b95db634 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:14.548849 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d57f148d-4faf-4d8d-9d48-9d98b95db634 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:14.574011 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-d57f148d-4faf-4d8d-9d48-9d98b95db634 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Getting quotas for project 44df2d570f634a79887bd48d6c2ec9ef. Resources: {'cores', 'instances', 'ram'} {{(pid=99512) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 15 20:03:14.579475 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-d57f148d-4faf-4d8d-9d48-9d98b95db634 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Getting quotas for user d710976383134829a1f71d1a1b5a2a5f and project 44df2d570f634a79887bd48d6c2ec9ef. Resources: {'cores', 'instances', 'ram'} {{(pid=99512) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 15 20:03:14.590922 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d57f148d-4faf-4d8d-9d48-9d98b95db634 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Going to run 1 instances... {{(pid=99512) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 15 20:03:14.593737 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d57f148d-4faf-4d8d-9d48-9d98b95db634 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 318e31f6-3faa-466b-8733-aec0c90a30bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='10d66d6e-f687-4228-93d1-67502c9b42e2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 15 20:03:14.650319 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d57f148d-4faf-4d8d-9d48-9d98b95db634 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.856719 Apr 15 20:03:14.651527 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 538/1146] 10.222.0.58 () {60 vars in 1137 bytes} [Thu Apr 15 20:03:13 2021] POST /compute/v2.1/servers => generated 380 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 15 20:03:14.662555 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-fd415d35-69ff-417a-8edd-9a738769afb2 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:14.663643 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-fd415d35-69ff-417a-8edd-9a738769afb2 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 318e31f6-3faa-466b-8733-aec0c90a30bd] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:14.745403 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-fd415d35-69ff-417a-8edd-9a738769afb2 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:14.753971 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-fd415d35-69ff-417a-8edd-9a738769afb2 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd" status: 200 len: 1218 microversion: 2.1 time: 0.095618 Apr 15 20:03:14.754587 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 609/1147] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:14 2021] GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:03:15.777341 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-71ef9994-5b2f-4172-9cbd-00478fa5341e tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:15.778652 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-71ef9994-5b2f-4172-9cbd-00478fa5341e tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 318e31f6-3faa-466b-8733-aec0c90a30bd] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:15.868293 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-71ef9994-5b2f-4172-9cbd-00478fa5341e tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:15.876866 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-71ef9994-5b2f-4172-9cbd-00478fa5341e tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd" status: 200 len: 1218 microversion: 2.1 time: 0.108525 Apr 15 20:03:15.877619 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 539/1148] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:15 2021] GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd => generated 1218 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:03:16.894330 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c661e958-bc7e-41ea-8299-78ddd5c5d647 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:16.895000 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c661e958-bc7e-41ea-8299-78ddd5c5d647 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 318e31f6-3faa-466b-8733-aec0c90a30bd] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:16.978132 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c661e958-bc7e-41ea-8299-78ddd5c5d647 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:16.987242 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c661e958-bc7e-41ea-8299-78ddd5c5d647 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd" status: 200 len: 1218 microversion: 2.1 time: 0.096991 Apr 15 20:03:16.988050 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 610/1149] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:16 2021] GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:03:18.005625 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a2d0ba1b-193d-497a-8e58-9aff84e9b1d2 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:18.006391 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a2d0ba1b-193d-497a-8e58-9aff84e9b1d2 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 318e31f6-3faa-466b-8733-aec0c90a30bd] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:18.084948 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a2d0ba1b-193d-497a-8e58-9aff84e9b1d2 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:18.093068 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a2d0ba1b-193d-497a-8e58-9aff84e9b1d2 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd" status: 200 len: 1218 microversion: 2.1 time: 0.091492 Apr 15 20:03:18.093683 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 540/1150] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:17 2021] GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:03:19.111430 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-35c126f6-4ca2-496b-9905-59d501ffaa93 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:19.112081 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-35c126f6-4ca2-496b-9905-59d501ffaa93 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 318e31f6-3faa-466b-8733-aec0c90a30bd] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:19.120491 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-35c126f6-4ca2-496b-9905-59d501ffaa93 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:19.121001 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-35c126f6-4ca2-496b-9905-59d501ffaa93 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:19.121847 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-35c126f6-4ca2-496b-9905-59d501ffaa93 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:19.122337 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-35c126f6-4ca2-496b-9905-59d501ffaa93 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:19.246851 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-35c126f6-4ca2-496b-9905-59d501ffaa93 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:19.255776 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-35c126f6-4ca2-496b-9905-59d501ffaa93 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd" status: 200 len: 1222 microversion: 2.1 time: 0.149061 Apr 15 20:03:19.256402 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 611/1151] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:19 2021] GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd => generated 1222 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:03:20.273576 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-89305cab-7f28-48ef-98a9-2eecbe4ded3d tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:20.274235 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-89305cab-7f28-48ef-98a9-2eecbe4ded3d tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 318e31f6-3faa-466b-8733-aec0c90a30bd] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:20.282680 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-89305cab-7f28-48ef-98a9-2eecbe4ded3d tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:20.283187 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-89305cab-7f28-48ef-98a9-2eecbe4ded3d tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:20.284068 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-89305cab-7f28-48ef-98a9-2eecbe4ded3d tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:20.284562 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-89305cab-7f28-48ef-98a9-2eecbe4ded3d tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:20.410775 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-89305cab-7f28-48ef-98a9-2eecbe4ded3d tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:20.419784 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-89305cab-7f28-48ef-98a9-2eecbe4ded3d tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd" status: 200 len: 1222 microversion: 2.1 time: 0.150182 Apr 15 20:03:20.420745 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 541/1152] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:20 2021] GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd => generated 1222 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:03:21.439054 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-2761ae78-a158-4cd2-acaf-9e2c883a7769 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:21.439753 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-2761ae78-a158-4cd2-acaf-9e2c883a7769 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 318e31f6-3faa-466b-8733-aec0c90a30bd] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:21.447632 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2761ae78-a158-4cd2-acaf-9e2c883a7769 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:21.448139 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2761ae78-a158-4cd2-acaf-9e2c883a7769 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:21.448967 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2761ae78-a158-4cd2-acaf-9e2c883a7769 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:21.449454 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2761ae78-a158-4cd2-acaf-9e2c883a7769 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:21.578257 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-2761ae78-a158-4cd2-acaf-9e2c883a7769 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:21.588082 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-2761ae78-a158-4cd2-acaf-9e2c883a7769 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd" status: 200 len: 1222 microversion: 2.1 time: 0.153710 Apr 15 20:03:21.588711 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 612/1153] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:21 2021] GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd => generated 1222 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:03:22.606205 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-954d4742-647a-407b-8732-d0093dbe080c tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:22.606877 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-954d4742-647a-407b-8732-d0093dbe080c tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 318e31f6-3faa-466b-8733-aec0c90a30bd] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:22.615715 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-954d4742-647a-407b-8732-d0093dbe080c tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:22.616231 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-954d4742-647a-407b-8732-d0093dbe080c tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:22.617091 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-954d4742-647a-407b-8732-d0093dbe080c tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:22.617589 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-954d4742-647a-407b-8732-d0093dbe080c tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:22.747645 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-954d4742-647a-407b-8732-d0093dbe080c tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:22.756987 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-954d4742-647a-407b-8732-d0093dbe080c tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd" status: 200 len: 1214 microversion: 2.1 time: 0.154907 Apr 15 20:03:22.757634 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 542/1154] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:22 2021] GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd => generated 1214 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:03:23.776500 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b70d334c-6a08-4e04-8060-b75c20da36fc tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:23.777110 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b70d334c-6a08-4e04-8060-b75c20da36fc tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 318e31f6-3faa-466b-8733-aec0c90a30bd] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:23.785417 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b70d334c-6a08-4e04-8060-b75c20da36fc tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:23.786174 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b70d334c-6a08-4e04-8060-b75c20da36fc tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:23.787003 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b70d334c-6a08-4e04-8060-b75c20da36fc tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:23.787526 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b70d334c-6a08-4e04-8060-b75c20da36fc tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:23.912358 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b70d334c-6a08-4e04-8060-b75c20da36fc tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:23.921162 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b70d334c-6a08-4e04-8060-b75c20da36fc tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd" status: 200 len: 1214 microversion: 2.1 time: 0.148782 Apr 15 20:03:23.921770 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 613/1155] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:23 2021] GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd => generated 1214 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:03:24.939371 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-1511f3b4-f973-41d2-91a6-9abf7426679d tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:24.940355 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-1511f3b4-f973-41d2-91a6-9abf7426679d tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 318e31f6-3faa-466b-8733-aec0c90a30bd] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:24.948588 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1511f3b4-f973-41d2-91a6-9abf7426679d tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:24.949364 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1511f3b4-f973-41d2-91a6-9abf7426679d tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:24.950300 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1511f3b4-f973-41d2-91a6-9abf7426679d tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:24.950887 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1511f3b4-f973-41d2-91a6-9abf7426679d tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:25.098314 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-1511f3b4-f973-41d2-91a6-9abf7426679d tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:25.107782 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-1511f3b4-f973-41d2-91a6-9abf7426679d tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd" status: 200 len: 1278 microversion: 2.1 time: 0.173107 Apr 15 20:03:25.108503 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 543/1156] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:24 2021] GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd => generated 1278 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:03:26.126987 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-62e1fb3e-5c7c-4d68-a9b6-f9cf4fe1c997 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:26.127900 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-62e1fb3e-5c7c-4d68-a9b6-f9cf4fe1c997 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 318e31f6-3faa-466b-8733-aec0c90a30bd] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:26.136233 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-62e1fb3e-5c7c-4d68-a9b6-f9cf4fe1c997 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:26.136832 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-62e1fb3e-5c7c-4d68-a9b6-f9cf4fe1c997 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:26.137762 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-62e1fb3e-5c7c-4d68-a9b6-f9cf4fe1c997 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:26.138357 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-62e1fb3e-5c7c-4d68-a9b6-f9cf4fe1c997 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:26.861461 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-62e1fb3e-5c7c-4d68-a9b6-f9cf4fe1c997 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:26.870204 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-62e1fb3e-5c7c-4d68-a9b6-f9cf4fe1c997 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd" status: 200 len: 1318 microversion: 2.1 time: 0.747808 Apr 15 20:03:26.870809 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 614/1157] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:26 2021] GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd => generated 1318 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:03:27.681588 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-80d5e8cf-630c-4801-bcb2-c193dd94edd2 req-cea01123-e6b9-4b96-a6f1-a31e8aae6acf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "318e31f6-3faa-466b-8733-aec0c90a30bd", "tag": "70dde193-a63c-4be3-b49a-989926274145"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:03:27.689215 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:03:27.689215 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:03:27.710123 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-80d5e8cf-630c-4801-bcb2-c193dd94edd2 req-cea01123-e6b9-4b96-a6f1-a31e8aae6acf service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:27.710891 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-80d5e8cf-630c-4801-bcb2-c193dd94edd2 req-cea01123-e6b9-4b96-a6f1-a31e8aae6acf service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:27.730080 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-80d5e8cf-630c-4801-bcb2-c193dd94edd2 req-cea01123-e6b9-4b96-a6f1-a31e8aae6acf service nova] Creating event network-changed:70dde193-a63c-4be3-b49a-989926274145 for instance 318e31f6-3faa-466b-8733-aec0c90a30bd on hv-cinder-78638 Apr 15 20:03:27.736147 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-80d5e8cf-630c-4801-bcb2-c193dd94edd2 req-cea01123-e6b9-4b96-a6f1-a31e8aae6acf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057992 Apr 15 20:03:27.736897 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 544/1158] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:03:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:03:27.889223 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-be5d7abd-2665-4a1e-a071-44d06d56d3ae tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:27.890109 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-be5d7abd-2665-4a1e-a071-44d06d56d3ae tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 318e31f6-3faa-466b-8733-aec0c90a30bd] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:27.897991 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-be5d7abd-2665-4a1e-a071-44d06d56d3ae tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:27.898510 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-be5d7abd-2665-4a1e-a071-44d06d56d3ae tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:27.899380 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-be5d7abd-2665-4a1e-a071-44d06d56d3ae tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:27.899885 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-be5d7abd-2665-4a1e-a071-44d06d56d3ae tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:28.358585 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-be5d7abd-2665-4a1e-a071-44d06d56d3ae tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:28.367914 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-be5d7abd-2665-4a1e-a071-44d06d56d3ae tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd" status: 200 len: 1318 microversion: 2.1 time: 0.482800 Apr 15 20:03:28.368537 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 615/1159] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:27 2021] GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd => generated 1318 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:03:29.386512 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-3e3b24fe-0e16-472c-91f5-f34657b4923e tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:29.387386 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-3e3b24fe-0e16-472c-91f5-f34657b4923e tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 318e31f6-3faa-466b-8733-aec0c90a30bd] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:29.395355 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3e3b24fe-0e16-472c-91f5-f34657b4923e tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:29.395869 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3e3b24fe-0e16-472c-91f5-f34657b4923e tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:29.396697 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3e3b24fe-0e16-472c-91f5-f34657b4923e tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:29.397230 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3e3b24fe-0e16-472c-91f5-f34657b4923e tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:29.611886 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3e3b24fe-0e16-472c-91f5-f34657b4923e tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:29.620656 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-3e3b24fe-0e16-472c-91f5-f34657b4923e tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd" status: 200 len: 1318 microversion: 2.1 time: 0.238780 Apr 15 20:03:29.621273 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 545/1160] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:29 2021] GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:03:30.638342 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-39471864-7a53-4a09-b434-5aca942da319 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:30.639026 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-39471864-7a53-4a09-b434-5aca942da319 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 318e31f6-3faa-466b-8733-aec0c90a30bd] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:30.647088 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-39471864-7a53-4a09-b434-5aca942da319 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:30.647637 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-39471864-7a53-4a09-b434-5aca942da319 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:30.648481 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-39471864-7a53-4a09-b434-5aca942da319 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:30.648982 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-39471864-7a53-4a09-b434-5aca942da319 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:30.863109 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-39471864-7a53-4a09-b434-5aca942da319 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:30.872038 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-39471864-7a53-4a09-b434-5aca942da319 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd" status: 200 len: 1318 microversion: 2.1 time: 0.237752 Apr 15 20:03:30.872651 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 616/1161] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:30 2021] GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:03:31.890052 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-5f896076-20b9-483b-b9c4-3cb4b6bb0d07 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:31.890647 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-5f896076-20b9-483b-b9c4-3cb4b6bb0d07 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 318e31f6-3faa-466b-8733-aec0c90a30bd] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:31.898586 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5f896076-20b9-483b-b9c4-3cb4b6bb0d07 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:31.899095 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5f896076-20b9-483b-b9c4-3cb4b6bb0d07 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:31.899947 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5f896076-20b9-483b-b9c4-3cb4b6bb0d07 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:31.900435 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5f896076-20b9-483b-b9c4-3cb4b6bb0d07 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:32.118693 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-5f896076-20b9-483b-b9c4-3cb4b6bb0d07 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:32.128050 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-5f896076-20b9-483b-b9c4-3cb4b6bb0d07 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd" status: 200 len: 1318 microversion: 2.1 time: 0.242088 Apr 15 20:03:32.128675 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 546/1162] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:31 2021] GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:03:33.146433 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7f0969f9-2f5c-4ddd-b42f-7adb531fb645 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:33.147102 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7f0969f9-2f5c-4ddd-b42f-7adb531fb645 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 318e31f6-3faa-466b-8733-aec0c90a30bd] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:33.154948 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7f0969f9-2f5c-4ddd-b42f-7adb531fb645 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:33.155499 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7f0969f9-2f5c-4ddd-b42f-7adb531fb645 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:33.156340 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7f0969f9-2f5c-4ddd-b42f-7adb531fb645 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:33.156843 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7f0969f9-2f5c-4ddd-b42f-7adb531fb645 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:33.371462 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-7f0969f9-2f5c-4ddd-b42f-7adb531fb645 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:33.383095 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7f0969f9-2f5c-4ddd-b42f-7adb531fb645 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd" status: 200 len: 1318 microversion: 2.1 time: 0.240556 Apr 15 20:03:33.383897 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 617/1163] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:33 2021] GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 20:03:34.401771 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d4b5355b-9c41-41ae-bb03-cb85beee3237 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:34.403116 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d4b5355b-9c41-41ae-bb03-cb85beee3237 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 318e31f6-3faa-466b-8733-aec0c90a30bd] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:34.412013 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d4b5355b-9c41-41ae-bb03-cb85beee3237 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:34.412527 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d4b5355b-9c41-41ae-bb03-cb85beee3237 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:34.413383 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d4b5355b-9c41-41ae-bb03-cb85beee3237 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:34.413933 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d4b5355b-9c41-41ae-bb03-cb85beee3237 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:34.550391 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-fa75c82b-68bc-43b5-941d-879912659441 req-baf4ee88-3dcf-4542-94db-2b449bcda032 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "318e31f6-3faa-466b-8733-aec0c90a30bd", "name": "network-vif-plugged", "status": "completed", "tag": "70dde193-a63c-4be3-b49a-989926274145"}]} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:03:34.552611 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:03:34.552611 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:03:34.563729 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-fa75c82b-68bc-43b5-941d-879912659441 req-baf4ee88-3dcf-4542-94db-2b449bcda032 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:34.564337 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-fa75c82b-68bc-43b5-941d-879912659441 req-baf4ee88-3dcf-4542-94db-2b449bcda032 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:34.582723 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-fa75c82b-68bc-43b5-941d-879912659441 req-baf4ee88-3dcf-4542-94db-2b449bcda032 service nova] Creating event network-vif-plugged:70dde193-a63c-4be3-b49a-989926274145 for instance 318e31f6-3faa-466b-8733-aec0c90a30bd on hv-cinder-78638 Apr 15 20:03:34.588002 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-fa75c82b-68bc-43b5-941d-879912659441 req-baf4ee88-3dcf-4542-94db-2b449bcda032 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117368 Apr 15 20:03:34.588672 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 618/1164] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:03:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:03:34.642693 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d4b5355b-9c41-41ae-bb03-cb85beee3237 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:34.652458 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d4b5355b-9c41-41ae-bb03-cb85beee3237 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd" status: 200 len: 1318 microversion: 2.1 time: 0.254744 Apr 15 20:03:34.653753 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 547/1165] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:34 2021] GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:03:35.671850 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-fb63dccc-586e-41b4-8ddd-11a9dae21809 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:35.672600 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-fb63dccc-586e-41b4-8ddd-11a9dae21809 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 318e31f6-3faa-466b-8733-aec0c90a30bd] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:35.680930 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fb63dccc-586e-41b4-8ddd-11a9dae21809 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:35.681448 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fb63dccc-586e-41b4-8ddd-11a9dae21809 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:35.682289 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fb63dccc-586e-41b4-8ddd-11a9dae21809 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:35.682784 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fb63dccc-586e-41b4-8ddd-11a9dae21809 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:35.828121 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b13c698b-2a37-41af-8169-f99fe9f2922d tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-53295799", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-934650097", "security_groups": [{"name": "tempest-secgroup-smoke-743425793"}], "block_device_mapping_v2": [{"uuid": "e73c2760-4c80-424a-baee-5b5c98e3bbb7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5a40994e-48a3-4ca3-b74f-8d7720ae07a5"}]}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:03:35.905857 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-fb63dccc-586e-41b4-8ddd-11a9dae21809 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:35.915524 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-fb63dccc-586e-41b4-8ddd-11a9dae21809 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd" status: 200 len: 1318 microversion: 2.1 time: 0.248173 Apr 15 20:03:35.916245 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 619/1166] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:35 2021] GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:03:36.021398 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.network.neutron [None req-b13c698b-2a37-41af-8169-f99fe9f2922d tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] validate_networks() for [('5a40994e-48a3-4ca3-b74f-8d7720ae07a5', None, None, None)] {{(pid=99512) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 15 20:03:36.853017 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-b13c698b-2a37-41af-8169-f99fe9f2922d tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Flavor limits 0:0:0 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 15 20:03:36.853477 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-b13c698b-2a37-41af-8169-f99fe9f2922d tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Image limits 0:0:0 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 15 20:03:36.854047 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-b13c698b-2a37-41af-8169-f99fe9f2922d tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Flavor pref 0:0:0 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 15 20:03:36.854517 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-b13c698b-2a37-41af-8169-f99fe9f2922d tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Image pref 0:0:0 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 15 20:03:36.854979 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-b13c698b-2a37-41af-8169-f99fe9f2922d tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 15 20:03:36.864395 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b13c698b-2a37-41af-8169-f99fe9f2922d tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:36.864916 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b13c698b-2a37-41af-8169-f99fe9f2922d tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:36.865796 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b13c698b-2a37-41af-8169-f99fe9f2922d tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:36.866290 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b13c698b-2a37-41af-8169-f99fe9f2922d tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:36.885331 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-b13c698b-2a37-41af-8169-f99fe9f2922d tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Getting quotas for project 3e2a79620ac740e5a6e598a862a97631. Resources: {'cores', 'instances', 'ram'} {{(pid=99512) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 15 20:03:36.889611 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-b13c698b-2a37-41af-8169-f99fe9f2922d tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Getting quotas for user 5c9d86e8f847470c8403807462b1f8cb and project 3e2a79620ac740e5a6e598a862a97631. Resources: {'cores', 'instances', 'ram'} {{(pid=99512) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 15 20:03:36.933514 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6954a102-0b5c-4098-a460-ce0a76f0cf75 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:36.934178 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6954a102-0b5c-4098-a460-ce0a76f0cf75 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 318e31f6-3faa-466b-8733-aec0c90a30bd] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:36.942708 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6954a102-0b5c-4098-a460-ce0a76f0cf75 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:36.943218 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6954a102-0b5c-4098-a460-ce0a76f0cf75 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:36.944099 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6954a102-0b5c-4098-a460-ce0a76f0cf75 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:36.944568 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6954a102-0b5c-4098-a460-ce0a76f0cf75 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:36.997656 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b13c698b-2a37-41af-8169-f99fe9f2922d tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Going to run 1 instances... {{(pid=99512) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 15 20:03:37.000353 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b13c698b-2a37-41af-8169-f99fe9f2922d tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: ee7a266a-70f6-4c26-b5e4-3c7c99a196b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e73c2760-4c80-424a-baee-5b5c98e3bbb7',volume_size=None,volume_type=None)] {{(pid=99512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 15 20:03:37.174407 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-6954a102-0b5c-4098-a460-ce0a76f0cf75 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:37.183421 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6954a102-0b5c-4098-a460-ce0a76f0cf75 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd" status: 200 len: 1509 microversion: 2.1 time: 0.253871 Apr 15 20:03:37.184027 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 620/1167] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:36 2021] GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd => generated 1509 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:03:37.190379 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b13c698b-2a37-41af-8169-f99fe9f2922d tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.366243 Apr 15 20:03:37.191057 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 548/1168] 10.222.0.58 () {60 vars in 1137 bytes} [Thu Apr 15 20:03:35 2021] POST /compute/v2.1/servers => generated 405 bytes in 1368 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 15 20:03:37.206816 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-27e68fbb-c7e5-4153-aadc-6d3349e0d3b3 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:37.207527 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-27e68fbb-c7e5-4153-aadc-6d3349e0d3b3 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: ee7a266a-70f6-4c26-b5e4-3c7c99a196b1] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:37.292185 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-27e68fbb-c7e5-4153-aadc-6d3349e0d3b3 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:37.301758 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-27e68fbb-c7e5-4153-aadc-6d3349e0d3b3 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1" status: 200 len: 1092 microversion: 2.1 time: 0.099505 Apr 15 20:03:37.302467 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 621/1169] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:37 2021] GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1 => generated 1092 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:03:38.324481 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e4b34df0-1e15-458f-bb4b-d4fb2dd521b1 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:38.326279 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e4b34df0-1e15-458f-bb4b-d4fb2dd521b1 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: ee7a266a-70f6-4c26-b5e4-3c7c99a196b1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:38.338790 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e4b34df0-1e15-458f-bb4b-d4fb2dd521b1 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:38.339421 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e4b34df0-1e15-458f-bb4b-d4fb2dd521b1 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:38.340450 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e4b34df0-1e15-458f-bb4b-d4fb2dd521b1 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:38.341019 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e4b34df0-1e15-458f-bb4b-d4fb2dd521b1 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:38.488946 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-e4b34df0-1e15-458f-bb4b-d4fb2dd521b1 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:38.497925 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e4b34df0-1e15-458f-bb4b-d4fb2dd521b1 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1" status: 200 len: 1208 microversion: 2.1 time: 0.180852 Apr 15 20:03:38.498550 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 549/1170] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:38 2021] GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1 => generated 1208 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:03:38.783947 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-bcf1a2c6-c7fc-47f0-bcdf-ea08d36fd9db tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "494e2274-6797-4dba-909c-491149ac698d"}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:03:38.785305 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-bcf1a2c6-c7fc-47f0-bcdf-ea08d36fd9db tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 318e31f6-3faa-466b-8733-aec0c90a30bd] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:38.794507 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bcf1a2c6-c7fc-47f0-bcdf-ea08d36fd9db tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:38.795109 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bcf1a2c6-c7fc-47f0-bcdf-ea08d36fd9db tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:38.796049 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bcf1a2c6-c7fc-47f0-bcdf-ea08d36fd9db tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:38.796655 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bcf1a2c6-c7fc-47f0-bcdf-ea08d36fd9db tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:39.188564 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-bcf1a2c6-c7fc-47f0-bcdf-ea08d36fd9db tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "POST /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.407561 Apr 15 20:03:39.189648 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 622/1171] 10.222.0.58 () {60 vars in 1313 bytes} [Thu Apr 15 20:03:38 2021] POST /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd/os-volume_attachments => generated 194 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:03:39.520051 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-43024113-a113-47ee-b38d-219ef8530f06 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:39.520715 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-43024113-a113-47ee-b38d-219ef8530f06 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: ee7a266a-70f6-4c26-b5e4-3c7c99a196b1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:39.529455 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-43024113-a113-47ee-b38d-219ef8530f06 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:39.530099 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-43024113-a113-47ee-b38d-219ef8530f06 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:39.531004 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-43024113-a113-47ee-b38d-219ef8530f06 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:39.531595 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-43024113-a113-47ee-b38d-219ef8530f06 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:40.032880 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-43024113-a113-47ee-b38d-219ef8530f06 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:40.042270 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-43024113-a113-47ee-b38d-219ef8530f06 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1" status: 200 len: 1263 microversion: 2.1 time: 0.526248 Apr 15 20:03:40.042897 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 550/1172] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:39 2021] GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1 => generated 1263 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:03:40.940765 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-42601818-7849-444a-b1c5-deb6438e6a05 req-d7be7e13-9e5d-4268-9987-6893a5305e35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee7a266a-70f6-4c26-b5e4-3c7c99a196b1", "tag": "d19ac357-560f-4e16-8746-937ee97d7e5c"}]} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:03:40.942727 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:03:40.942727 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:03:40.953056 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-42601818-7849-444a-b1c5-deb6438e6a05 req-d7be7e13-9e5d-4268-9987-6893a5305e35 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:40.954100 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-42601818-7849-444a-b1c5-deb6438e6a05 req-d7be7e13-9e5d-4268-9987-6893a5305e35 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:40.975894 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-42601818-7849-444a-b1c5-deb6438e6a05 req-d7be7e13-9e5d-4268-9987-6893a5305e35 service nova] Creating event network-changed:d19ac357-560f-4e16-8746-937ee97d7e5c for instance ee7a266a-70f6-4c26-b5e4-3c7c99a196b1 on hv-cinder-78638 Apr 15 20:03:40.981079 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-42601818-7849-444a-b1c5-deb6438e6a05 req-d7be7e13-9e5d-4268-9987-6893a5305e35 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045421 Apr 15 20:03:40.981758 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 623/1173] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:03:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:03:41.060596 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9a1fdfd7-6adc-4929-8f04-44aeb660df4b tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:41.061313 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9a1fdfd7-6adc-4929-8f04-44aeb660df4b tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: ee7a266a-70f6-4c26-b5e4-3c7c99a196b1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:41.069580 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9a1fdfd7-6adc-4929-8f04-44aeb660df4b tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:41.070088 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9a1fdfd7-6adc-4929-8f04-44aeb660df4b tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:41.070927 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9a1fdfd7-6adc-4929-8f04-44aeb660df4b tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:41.071475 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9a1fdfd7-6adc-4929-8f04-44aeb660df4b tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:41.414726 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9a1fdfd7-6adc-4929-8f04-44aeb660df4b tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:41.423875 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9a1fdfd7-6adc-4929-8f04-44aeb660df4b tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1" status: 200 len: 1263 microversion: 2.1 time: 0.367037 Apr 15 20:03:41.424285 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 551/1174] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:41 2021] GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1 => generated 1263 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 20:03:42.442803 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6cfedf54-2ed2-40ac-a02d-fe51507bf9de tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:42.443610 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6cfedf54-2ed2-40ac-a02d-fe51507bf9de tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: ee7a266a-70f6-4c26-b5e4-3c7c99a196b1] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:42.451760 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6cfedf54-2ed2-40ac-a02d-fe51507bf9de tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:42.452278 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6cfedf54-2ed2-40ac-a02d-fe51507bf9de tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:42.453628 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6cfedf54-2ed2-40ac-a02d-fe51507bf9de tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:42.454297 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6cfedf54-2ed2-40ac-a02d-fe51507bf9de tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:42.831197 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-6cfedf54-2ed2-40ac-a02d-fe51507bf9de tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:42.840175 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6cfedf54-2ed2-40ac-a02d-fe51507bf9de tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1" status: 200 len: 1263 microversion: 2.1 time: 0.402159 Apr 15 20:03:42.840805 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 624/1175] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:42 2021] GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1 => generated 1263 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:03:43.857280 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6f65b0da-6c9c-402a-8642-c666a57e644c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:43.857986 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6f65b0da-6c9c-402a-8642-c666a57e644c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: ee7a266a-70f6-4c26-b5e4-3c7c99a196b1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:43.865773 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6f65b0da-6c9c-402a-8642-c666a57e644c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:43.866279 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6f65b0da-6c9c-402a-8642-c666a57e644c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:43.867106 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6f65b0da-6c9c-402a-8642-c666a57e644c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:43.867642 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6f65b0da-6c9c-402a-8642-c666a57e644c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:44.076472 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-6f65b0da-6c9c-402a-8642-c666a57e644c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:44.086097 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6f65b0da-6c9c-402a-8642-c666a57e644c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1" status: 200 len: 1263 microversion: 2.1 time: 0.232769 Apr 15 20:03:44.086713 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 552/1176] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:43 2021] GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1 => generated 1263 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:03:45.104526 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-adb7f8f7-b4c2-48e7-b703-d59d3cdd3dd5 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:45.105199 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-adb7f8f7-b4c2-48e7-b703-d59d3cdd3dd5 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: ee7a266a-70f6-4c26-b5e4-3c7c99a196b1] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:45.114196 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-adb7f8f7-b4c2-48e7-b703-d59d3cdd3dd5 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:45.114749 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-adb7f8f7-b4c2-48e7-b703-d59d3cdd3dd5 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:45.115615 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-adb7f8f7-b4c2-48e7-b703-d59d3cdd3dd5 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:45.116133 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-adb7f8f7-b4c2-48e7-b703-d59d3cdd3dd5 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:45.325737 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-adb7f8f7-b4c2-48e7-b703-d59d3cdd3dd5 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:45.335017 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-adb7f8f7-b4c2-48e7-b703-d59d3cdd3dd5 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1" status: 200 len: 1263 microversion: 2.1 time: 0.234525 Apr 15 20:03:45.335674 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 625/1177] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:45 2021] GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1 => generated 1263 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:03:46.353383 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-45bf4c16-4e25-4a5a-9e13-0ceac809dd06 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:46.354066 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-45bf4c16-4e25-4a5a-9e13-0ceac809dd06 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: ee7a266a-70f6-4c26-b5e4-3c7c99a196b1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:46.365103 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-45bf4c16-4e25-4a5a-9e13-0ceac809dd06 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:46.365620 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-45bf4c16-4e25-4a5a-9e13-0ceac809dd06 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:46.366537 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-45bf4c16-4e25-4a5a-9e13-0ceac809dd06 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:46.367036 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-45bf4c16-4e25-4a5a-9e13-0ceac809dd06 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:46.583523 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-45bf4c16-4e25-4a5a-9e13-0ceac809dd06 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:46.592279 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-45bf4c16-4e25-4a5a-9e13-0ceac809dd06 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1" status: 200 len: 1263 microversion: 2.1 time: 0.242951 Apr 15 20:03:46.592887 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 553/1178] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:46 2021] GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1 => generated 1263 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:03:47.073434 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-177e113d-b561-4eb7-949b-dd515b6523a4 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1178997778", "imageRef": "10d66d6e-f687-4228-93d1-67502c9b42e2", "flavorRef": "452", "networks": [{"uuid": "19b452bb-c309-496d-a8d9-d08c6427af14"}]}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:03:47.155383 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.network.neutron [None req-177e113d-b561-4eb7-949b-dd515b6523a4 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] validate_networks() for [('19b452bb-c309-496d-a8d9-d08c6427af14', None, None, None)] {{(pid=99511) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 15 20:03:47.611213 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e28d8a8d-d600-497f-acaf-d04166e68cf0 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:47.611805 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e28d8a8d-d600-497f-acaf-d04166e68cf0 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: ee7a266a-70f6-4c26-b5e4-3c7c99a196b1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:47.622959 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e28d8a8d-d600-497f-acaf-d04166e68cf0 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:47.623574 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e28d8a8d-d600-497f-acaf-d04166e68cf0 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:47.624585 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e28d8a8d-d600-497f-acaf-d04166e68cf0 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:47.625790 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e28d8a8d-d600-497f-acaf-d04166e68cf0 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:47.831712 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-177e113d-b561-4eb7-949b-dd515b6523a4 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Flavor limits 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 15 20:03:47.832271 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-177e113d-b561-4eb7-949b-dd515b6523a4 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Image limits 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 15 20:03:47.832823 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-177e113d-b561-4eb7-949b-dd515b6523a4 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Flavor pref 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 15 20:03:47.833289 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-177e113d-b561-4eb7-949b-dd515b6523a4 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Image pref 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 15 20:03:47.833756 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-177e113d-b561-4eb7-949b-dd515b6523a4 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 15 20:03:47.842960 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-177e113d-b561-4eb7-949b-dd515b6523a4 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:47.845570 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-177e113d-b561-4eb7-949b-dd515b6523a4 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:47.846654 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-177e113d-b561-4eb7-949b-dd515b6523a4 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:47.847233 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-177e113d-b561-4eb7-949b-dd515b6523a4 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:47.865914 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-177e113d-b561-4eb7-949b-dd515b6523a4 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Getting quotas for project 44df2d570f634a79887bd48d6c2ec9ef. Resources: {'cores', 'instances', 'ram'} {{(pid=99511) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 15 20:03:47.870276 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-177e113d-b561-4eb7-949b-dd515b6523a4 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Getting quotas for user d710976383134829a1f71d1a1b5a2a5f and project 44df2d570f634a79887bd48d6c2ec9ef. Resources: {'cores', 'instances', 'ram'} {{(pid=99511) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 15 20:03:47.882059 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-177e113d-b561-4eb7-949b-dd515b6523a4 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Going to run 1 instances... {{(pid=99511) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 15 20:03:47.884717 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-177e113d-b561-4eb7-949b-dd515b6523a4 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 118b1950-dfda-48f8-980a-00ead8b8d208] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='10d66d6e-f687-4228-93d1-67502c9b42e2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 15 20:03:47.895404 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-e28d8a8d-d600-497f-acaf-d04166e68cf0 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:47.905477 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e28d8a8d-d600-497f-acaf-d04166e68cf0 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1" status: 200 len: 1263 microversion: 2.1 time: 0.299017 Apr 15 20:03:47.906327 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 554/1179] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:47 2021] GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1 => generated 1263 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 20:03:47.935003 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-177e113d-b561-4eb7-949b-dd515b6523a4 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.865669 Apr 15 20:03:47.935743 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 626/1180] 10.222.0.58 () {60 vars in 1137 bytes} [Thu Apr 15 20:03:47 2021] POST /compute/v2.1/servers => generated 380 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 15 20:03:47.946759 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-4d0c59c4-82e8-4cc1-a26b-19cfb3db0dab tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:47.947593 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-4d0c59c4-82e8-4cc1-a26b-19cfb3db0dab tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 118b1950-dfda-48f8-980a-00ead8b8d208] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:48.025343 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-4d0c59c4-82e8-4cc1-a26b-19cfb3db0dab tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:48.034550 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-4d0c59c4-82e8-4cc1-a26b-19cfb3db0dab tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/118b1950-dfda-48f8-980a-00ead8b8d208" status: 200 len: 1218 microversion: 2.1 time: 0.091724 Apr 15 20:03:48.035202 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 555/1181] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:47 2021] GET /compute/v2.1/servers/118b1950-dfda-48f8-980a-00ead8b8d208 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:03:48.923972 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-09ccd882-ca82-4f19-87ef-cc2a8518d5b4 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:48.924678 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-09ccd882-ca82-4f19-87ef-cc2a8518d5b4 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: ee7a266a-70f6-4c26-b5e4-3c7c99a196b1] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:48.933713 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-09ccd882-ca82-4f19-87ef-cc2a8518d5b4 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:48.934228 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-09ccd882-ca82-4f19-87ef-cc2a8518d5b4 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:48.935086 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-09ccd882-ca82-4f19-87ef-cc2a8518d5b4 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:48.935611 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-09ccd882-ca82-4f19-87ef-cc2a8518d5b4 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:49.052853 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b9e3f2c6-a1d0-4205-bd0c-1e7f84a4e081 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:49.053557 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b9e3f2c6-a1d0-4205-bd0c-1e7f84a4e081 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 118b1950-dfda-48f8-980a-00ead8b8d208] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:49.065768 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b9e3f2c6-a1d0-4205-bd0c-1e7f84a4e081 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:49.066280 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b9e3f2c6-a1d0-4205-bd0c-1e7f84a4e081 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:49.067129 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b9e3f2c6-a1d0-4205-bd0c-1e7f84a4e081 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:49.067648 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b9e3f2c6-a1d0-4205-bd0c-1e7f84a4e081 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:49.224706 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b9e3f2c6-a1d0-4205-bd0c-1e7f84a4e081 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:49.233907 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b9e3f2c6-a1d0-4205-bd0c-1e7f84a4e081 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/118b1950-dfda-48f8-980a-00ead8b8d208" status: 200 len: 1288 microversion: 2.1 time: 0.185009 Apr 15 20:03:49.235303 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 556/1182] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:49 2021] GET /compute/v2.1/servers/118b1950-dfda-48f8-980a-00ead8b8d208 => generated 1288 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 20:03:49.374655 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-09ccd882-ca82-4f19-87ef-cc2a8518d5b4 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:49.384244 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-09ccd882-ca82-4f19-87ef-cc2a8518d5b4 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1" status: 200 len: 1263 microversion: 2.1 time: 0.464612 Apr 15 20:03:49.384867 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 627/1183] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:48 2021] GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1 => generated 1263 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:03:50.253186 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-cea37bce-bdfa-4f14-b016-7ea5126a4efd tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:50.253862 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-cea37bce-bdfa-4f14-b016-7ea5126a4efd tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 118b1950-dfda-48f8-980a-00ead8b8d208] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:50.261931 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cea37bce-bdfa-4f14-b016-7ea5126a4efd tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:50.262450 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cea37bce-bdfa-4f14-b016-7ea5126a4efd tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:50.263326 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cea37bce-bdfa-4f14-b016-7ea5126a4efd tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:50.263846 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cea37bce-bdfa-4f14-b016-7ea5126a4efd tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:50.402438 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-5f582b21-38f7-4caa-b30a-5f58360daf7c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:50.403089 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-5f582b21-38f7-4caa-b30a-5f58360daf7c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: ee7a266a-70f6-4c26-b5e4-3c7c99a196b1] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:50.412084 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5f582b21-38f7-4caa-b30a-5f58360daf7c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:50.412827 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5f582b21-38f7-4caa-b30a-5f58360daf7c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:50.413907 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5f582b21-38f7-4caa-b30a-5f58360daf7c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:50.414597 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5f582b21-38f7-4caa-b30a-5f58360daf7c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:51.098938 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-cea37bce-bdfa-4f14-b016-7ea5126a4efd tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:51.108499 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-cea37bce-bdfa-4f14-b016-7ea5126a4efd tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/118b1950-dfda-48f8-980a-00ead8b8d208" status: 200 len: 1318 microversion: 2.1 time: 0.859777 Apr 15 20:03:51.110124 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 557/1184] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:50 2021] GET /compute/v2.1/servers/118b1950-dfda-48f8-980a-00ead8b8d208 => generated 1318 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:03:51.130216 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-5f582b21-38f7-4caa-b30a-5f58360daf7c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:51.139170 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-5f582b21-38f7-4caa-b30a-5f58360daf7c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1" status: 200 len: 1263 microversion: 2.1 time: 0.740711 Apr 15 20:03:51.140019 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 628/1185] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:50 2021] GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1 => generated 1263 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:03:51.944218 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-8e1fd429-a8c8-4e3e-95ba-3f5cde1df0a2 req-2eff7063-cd58-48ff-a867-c0b6d61de059 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "118b1950-dfda-48f8-980a-00ead8b8d208", "tag": "0e03daab-9107-44f5-b911-4333acb78689"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:03:51.946570 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:03:51.946570 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:03:51.957635 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-8e1fd429-a8c8-4e3e-95ba-3f5cde1df0a2 req-2eff7063-cd58-48ff-a867-c0b6d61de059 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:51.958404 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-8e1fd429-a8c8-4e3e-95ba-3f5cde1df0a2 req-2eff7063-cd58-48ff-a867-c0b6d61de059 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:51.977616 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-8e1fd429-a8c8-4e3e-95ba-3f5cde1df0a2 req-2eff7063-cd58-48ff-a867-c0b6d61de059 service nova] Creating event network-changed:0e03daab-9107-44f5-b911-4333acb78689 for instance 118b1950-dfda-48f8-980a-00ead8b8d208 on hv-cinder-78638 Apr 15 20:03:51.983225 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-8e1fd429-a8c8-4e3e-95ba-3f5cde1df0a2 req-2eff7063-cd58-48ff-a867-c0b6d61de059 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043084 Apr 15 20:03:51.984121 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 558/1186] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:03:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:03:52.127397 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d4e26885-00cf-4be8-89f5-6230e1309c97 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:52.128212 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d4e26885-00cf-4be8-89f5-6230e1309c97 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 118b1950-dfda-48f8-980a-00ead8b8d208] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:52.136432 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d4e26885-00cf-4be8-89f5-6230e1309c97 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:52.137188 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d4e26885-00cf-4be8-89f5-6230e1309c97 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:52.138043 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d4e26885-00cf-4be8-89f5-6230e1309c97 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:52.138537 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d4e26885-00cf-4be8-89f5-6230e1309c97 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:52.158205 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-bbe4aaeb-87ec-4d16-ae16-65896fc70b89 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:52.159397 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-bbe4aaeb-87ec-4d16-ae16-65896fc70b89 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: ee7a266a-70f6-4c26-b5e4-3c7c99a196b1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:52.168284 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bbe4aaeb-87ec-4d16-ae16-65896fc70b89 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:52.169255 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bbe4aaeb-87ec-4d16-ae16-65896fc70b89 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:52.170330 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bbe4aaeb-87ec-4d16-ae16-65896fc70b89 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:52.171232 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bbe4aaeb-87ec-4d16-ae16-65896fc70b89 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:52.675265 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d4e26885-00cf-4be8-89f5-6230e1309c97 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:52.685033 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d4e26885-00cf-4be8-89f5-6230e1309c97 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/118b1950-dfda-48f8-980a-00ead8b8d208" status: 200 len: 1318 microversion: 2.1 time: 0.561920 Apr 15 20:03:52.685958 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 629/1187] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:52 2021] GET /compute/v2.1/servers/118b1950-dfda-48f8-980a-00ead8b8d208 => generated 1318 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:03:52.692117 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-1c95cebd-e2f0-4d23-b51c-de3f47778a15 req-05097517-8d55-4e1a-95af-2c79b2b95587 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee7a266a-70f6-4c26-b5e4-3c7c99a196b1", "name": "network-vif-plugged", "status": "completed", "tag": "d19ac357-560f-4e16-8746-937ee97d7e5c"}]} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:03:52.694170 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:03:52.694170 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:03:52.704389 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-1c95cebd-e2f0-4d23-b51c-de3f47778a15 req-05097517-8d55-4e1a-95af-2c79b2b95587 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:52.705173 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-1c95cebd-e2f0-4d23-b51c-de3f47778a15 req-05097517-8d55-4e1a-95af-2c79b2b95587 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:52.715639 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-bbe4aaeb-87ec-4d16-ae16-65896fc70b89 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:52.726678 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-1c95cebd-e2f0-4d23-b51c-de3f47778a15 req-05097517-8d55-4e1a-95af-2c79b2b95587 service nova] Creating event network-vif-plugged:d19ac357-560f-4e16-8746-937ee97d7e5c for instance ee7a266a-70f6-4c26-b5e4-3c7c99a196b1 on hv-cinder-78638 Apr 15 20:03:52.732223 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-1c95cebd-e2f0-4d23-b51c-de3f47778a15 req-05097517-8d55-4e1a-95af-2c79b2b95587 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044802 Apr 15 20:03:52.733088 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 630/1188] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:03:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:03:52.735752 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-bbe4aaeb-87ec-4d16-ae16-65896fc70b89 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1" status: 200 len: 1263 microversion: 2.1 time: 0.582295 Apr 15 20:03:52.736437 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 559/1189] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:52 2021] GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1 => generated 1263 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:03:53.705536 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b7ea8969-d45b-43e4-a9e6-dc135f61b204 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:53.707089 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b7ea8969-d45b-43e4-a9e6-dc135f61b204 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 118b1950-dfda-48f8-980a-00ead8b8d208] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:53.718112 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b7ea8969-d45b-43e4-a9e6-dc135f61b204 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:53.719808 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b7ea8969-d45b-43e4-a9e6-dc135f61b204 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:53.720824 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b7ea8969-d45b-43e4-a9e6-dc135f61b204 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:53.721836 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b7ea8969-d45b-43e4-a9e6-dc135f61b204 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:53.753832 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-3666d52d-54f2-44e2-9b83-2a280e661bcf tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:53.754516 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-3666d52d-54f2-44e2-9b83-2a280e661bcf tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: ee7a266a-70f6-4c26-b5e4-3c7c99a196b1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:53.762391 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3666d52d-54f2-44e2-9b83-2a280e661bcf tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:53.762911 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3666d52d-54f2-44e2-9b83-2a280e661bcf tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:53.763800 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3666d52d-54f2-44e2-9b83-2a280e661bcf tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:53.764300 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3666d52d-54f2-44e2-9b83-2a280e661bcf tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:54.053377 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b7ea8969-d45b-43e4-a9e6-dc135f61b204 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:54.060672 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3666d52d-54f2-44e2-9b83-2a280e661bcf tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:54.062944 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b7ea8969-d45b-43e4-a9e6-dc135f61b204 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/118b1950-dfda-48f8-980a-00ead8b8d208" status: 200 len: 1318 microversion: 2.1 time: 0.362087 Apr 15 20:03:54.063628 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 631/1190] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:53 2021] GET /compute/v2.1/servers/118b1950-dfda-48f8-980a-00ead8b8d208 => generated 1318 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:03:54.070378 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-3666d52d-54f2-44e2-9b83-2a280e661bcf tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1" status: 200 len: 1263 microversion: 2.1 time: 0.320739 Apr 15 20:03:54.071007 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 560/1191] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:53 2021] GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1 => generated 1263 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:03:55.081938 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-652e1ead-e82d-4fe2-ac08-46c2f03fa289 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:55.082605 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-652e1ead-e82d-4fe2-ac08-46c2f03fa289 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 118b1950-dfda-48f8-980a-00ead8b8d208] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:55.089330 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-2a095066-2f90-4ce5-baf5-ece7e8fcc5f0 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:55.090010 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-2a095066-2f90-4ce5-baf5-ece7e8fcc5f0 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: ee7a266a-70f6-4c26-b5e4-3c7c99a196b1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:55.090442 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-652e1ead-e82d-4fe2-ac08-46c2f03fa289 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:55.090950 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-652e1ead-e82d-4fe2-ac08-46c2f03fa289 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:55.091825 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-652e1ead-e82d-4fe2-ac08-46c2f03fa289 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:55.092314 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-652e1ead-e82d-4fe2-ac08-46c2f03fa289 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:55.098450 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2a095066-2f90-4ce5-baf5-ece7e8fcc5f0 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:55.098963 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2a095066-2f90-4ce5-baf5-ece7e8fcc5f0 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:55.099840 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2a095066-2f90-4ce5-baf5-ece7e8fcc5f0 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:55.100340 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2a095066-2f90-4ce5-baf5-ece7e8fcc5f0 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:55.408527 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-652e1ead-e82d-4fe2-ac08-46c2f03fa289 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:55.416163 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-2a095066-2f90-4ce5-baf5-ece7e8fcc5f0 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:55.417776 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-652e1ead-e82d-4fe2-ac08-46c2f03fa289 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/118b1950-dfda-48f8-980a-00ead8b8d208" status: 200 len: 1318 microversion: 2.1 time: 0.340992 Apr 15 20:03:55.418412 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 632/1192] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:55 2021] GET /compute/v2.1/servers/118b1950-dfda-48f8-980a-00ead8b8d208 => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:03:55.425787 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-2a095066-2f90-4ce5-baf5-ece7e8fcc5f0 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1" status: 200 len: 1451 microversion: 2.1 time: 0.340470 Apr 15 20:03:55.426397 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 561/1193] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:55 2021] GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1 => generated 1451 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 20:03:55.443014 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e4bce49c-e8ea-4e9c-b04c-08bbf92e822c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:55.443734 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e4bce49c-e8ea-4e9c-b04c-08bbf92e822c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: ee7a266a-70f6-4c26-b5e4-3c7c99a196b1] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:55.451402 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e4bce49c-e8ea-4e9c-b04c-08bbf92e822c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:55.451911 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e4bce49c-e8ea-4e9c-b04c-08bbf92e822c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:55.452748 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e4bce49c-e8ea-4e9c-b04c-08bbf92e822c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:55.453243 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e4bce49c-e8ea-4e9c-b04c-08bbf92e822c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:55.663116 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-e4bce49c-e8ea-4e9c-b04c-08bbf92e822c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:55.672095 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e4bce49c-e8ea-4e9c-b04c-08bbf92e822c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1" status: 200 len: 1451 microversion: 2.1 time: 0.232887 Apr 15 20:03:55.672716 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 633/1194] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:55 2021] GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1 => generated 1451 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:03:56.436001 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-84da06d3-f2d6-4f64-86c1-0575dec72a67 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:56.436650 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-84da06d3-f2d6-4f64-86c1-0575dec72a67 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 118b1950-dfda-48f8-980a-00ead8b8d208] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:56.446423 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-84da06d3-f2d6-4f64-86c1-0575dec72a67 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:56.446927 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-84da06d3-f2d6-4f64-86c1-0575dec72a67 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:56.447787 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-84da06d3-f2d6-4f64-86c1-0575dec72a67 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:56.448277 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-84da06d3-f2d6-4f64-86c1-0575dec72a67 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:57.042056 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-84da06d3-f2d6-4f64-86c1-0575dec72a67 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:57.051099 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-84da06d3-f2d6-4f64-86c1-0575dec72a67 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/118b1950-dfda-48f8-980a-00ead8b8d208" status: 200 len: 1318 microversion: 2.1 time: 0.619411 Apr 15 20:03:57.051983 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 562/1195] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:56 2021] GET /compute/v2.1/servers/118b1950-dfda-48f8-980a-00ead8b8d208 => generated 1318 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:03:58.069264 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a80f0cbe-570c-4d99-a42b-8ea2d82f4648 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:58.069897 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a80f0cbe-570c-4d99-a42b-8ea2d82f4648 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 118b1950-dfda-48f8-980a-00ead8b8d208] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:58.078257 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a80f0cbe-570c-4d99-a42b-8ea2d82f4648 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:58.079254 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a80f0cbe-570c-4d99-a42b-8ea2d82f4648 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:58.080109 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a80f0cbe-570c-4d99-a42b-8ea2d82f4648 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:58.080603 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a80f0cbe-570c-4d99-a42b-8ea2d82f4648 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:58.625073 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a80f0cbe-570c-4d99-a42b-8ea2d82f4648 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:03:58.655602 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a80f0cbe-570c-4d99-a42b-8ea2d82f4648 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/118b1950-dfda-48f8-980a-00ead8b8d208" status: 200 len: 1318 microversion: 2.1 time: 0.590343 Apr 15 20:03:58.670085 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 634/1196] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:58 2021] GET /compute/v2.1/servers/118b1950-dfda-48f8-980a-00ead8b8d208 => generated 1318 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:03:58.694609 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-e2a5fa5a-878d-4300-8241-598799d9a2ec req-e6ec8e36-7d8e-4520-8e90-9595bdb7d6bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "118b1950-dfda-48f8-980a-00ead8b8d208", "name": "network-vif-plugged", "status": "completed", "tag": "0e03daab-9107-44f5-b911-4333acb78689"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:03:58.696491 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:03:58.696491 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:03:58.709598 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-e2a5fa5a-878d-4300-8241-598799d9a2ec req-e6ec8e36-7d8e-4520-8e90-9595bdb7d6bd service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:58.710083 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-e2a5fa5a-878d-4300-8241-598799d9a2ec req-e6ec8e36-7d8e-4520-8e90-9595bdb7d6bd service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:58.744937 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-e2a5fa5a-878d-4300-8241-598799d9a2ec req-e6ec8e36-7d8e-4520-8e90-9595bdb7d6bd service nova] Creating event network-vif-plugged:0e03daab-9107-44f5-b911-4333acb78689 for instance 118b1950-dfda-48f8-980a-00ead8b8d208 on hv-cinder-78638 Apr 15 20:03:58.751233 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-e2a5fa5a-878d-4300-8241-598799d9a2ec req-e6ec8e36-7d8e-4520-8e90-9595bdb7d6bd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059925 Apr 15 20:03:58.752493 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 563/1197] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:03:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:03:59.509042 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-9eab446b-0121-4aae-9504-5edadb341229 req-29f42e6e-b526-4e50-82b4-ec83ff9e4ece service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee7a266a-70f6-4c26-b5e4-3c7c99a196b1", "tag": "d19ac357-560f-4e16-8746-937ee97d7e5c"}]} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:03:59.510772 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:03:59.510772 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:03:59.520553 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-9eab446b-0121-4aae-9504-5edadb341229 req-29f42e6e-b526-4e50-82b4-ec83ff9e4ece service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:59.521343 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-9eab446b-0121-4aae-9504-5edadb341229 req-29f42e6e-b526-4e50-82b4-ec83ff9e4ece service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:59.540974 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-9eab446b-0121-4aae-9504-5edadb341229 req-29f42e6e-b526-4e50-82b4-ec83ff9e4ece service nova] Creating event network-changed:d19ac357-560f-4e16-8746-937ee97d7e5c for instance ee7a266a-70f6-4c26-b5e4-3c7c99a196b1 on hv-cinder-78638 Apr 15 20:03:59.546508 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-9eab446b-0121-4aae-9504-5edadb341229 req-29f42e6e-b526-4e50-82b4-ec83ff9e4ece service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041482 Apr 15 20:03:59.547182 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 635/1198] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:03:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:03:59.678348 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-351c6065-55d8-4d84-b15c-4a86f39c7e24 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:03:59.679400 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-351c6065-55d8-4d84-b15c-4a86f39c7e24 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 118b1950-dfda-48f8-980a-00ead8b8d208] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:03:59.702381 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-351c6065-55d8-4d84-b15c-4a86f39c7e24 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:59.702983 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-351c6065-55d8-4d84-b15c-4a86f39c7e24 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:03:59.713447 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-351c6065-55d8-4d84-b15c-4a86f39c7e24 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:03:59.714395 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-351c6065-55d8-4d84-b15c-4a86f39c7e24 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:00.106165 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-351c6065-55d8-4d84-b15c-4a86f39c7e24 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:04:00.115313 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-351c6065-55d8-4d84-b15c-4a86f39c7e24 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/118b1950-dfda-48f8-980a-00ead8b8d208" status: 200 len: 1318 microversion: 2.1 time: 0.442107 Apr 15 20:04:00.115933 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 564/1199] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:03:59 2021] GET /compute/v2.1/servers/118b1950-dfda-48f8-980a-00ead8b8d208 => generated 1318 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 20:04:01.134834 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-bda71592-734c-4dac-8be9-85990ba624a6 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:04:01.135633 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-bda71592-734c-4dac-8be9-85990ba624a6 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 118b1950-dfda-48f8-980a-00ead8b8d208] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:04:01.143862 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bda71592-734c-4dac-8be9-85990ba624a6 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:01.144369 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bda71592-734c-4dac-8be9-85990ba624a6 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:01.145252 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bda71592-734c-4dac-8be9-85990ba624a6 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:01.145741 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bda71592-734c-4dac-8be9-85990ba624a6 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:01.371481 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-bda71592-734c-4dac-8be9-85990ba624a6 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:04:01.380489 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-bda71592-734c-4dac-8be9-85990ba624a6 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/118b1950-dfda-48f8-980a-00ead8b8d208" status: 200 len: 1508 microversion: 2.1 time: 0.250282 Apr 15 20:04:01.381107 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 636/1200] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:04:01 2021] GET /compute/v2.1/servers/118b1950-dfda-48f8-980a-00ead8b8d208 => generated 1508 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:04:01.398780 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7015ddea-d7b5-4202-a63f-7b50ba23edda tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "494e2274-6797-4dba-909c-491149ac698d"}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:04:01.400006 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7015ddea-d7b5-4202-a63f-7b50ba23edda tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 118b1950-dfda-48f8-980a-00ead8b8d208] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:04:01.408613 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7015ddea-d7b5-4202-a63f-7b50ba23edda tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:01.409127 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7015ddea-d7b5-4202-a63f-7b50ba23edda tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:01.409970 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7015ddea-d7b5-4202-a63f-7b50ba23edda tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:01.410745 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7015ddea-d7b5-4202-a63f-7b50ba23edda tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:01.582542 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-7015ddea-d7b5-4202-a63f-7b50ba23edda tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] HTTP exception thrown: Invalid volume: volume 494e2274-6797-4dba-909c-491149ac698d is already attached to instances: 318e31f6-3faa-466b-8733-aec0c90a30bd Apr 15 20:04:01.583209 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7015ddea-d7b5-4202-a63f-7b50ba23edda tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Returning 400 to user: Invalid volume: volume 494e2274-6797-4dba-909c-491149ac698d is already attached to instances: 318e31f6-3faa-466b-8733-aec0c90a30bd {{(pid=99512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 20:04:01.584163 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7015ddea-d7b5-4202-a63f-7b50ba23edda tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "POST /compute/v2.1/servers/118b1950-dfda-48f8-980a-00ead8b8d208/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.189664 Apr 15 20:04:01.584772 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 565/1201] 10.222.0.58 () {60 vars in 1313 bytes} [Thu Apr 15 20:04:01 2021] POST /compute/v2.1/servers/118b1950-dfda-48f8-980a-00ead8b8d208/os-volume_attachments => generated 174 bytes in 191 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 15 20:04:01.699355 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b40d9ec4-6f64-42ff-b418-41afff4c3716 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:04:01.699917 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b40d9ec4-6f64-42ff-b418-41afff4c3716 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 318e31f6-3faa-466b-8733-aec0c90a30bd] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:04:01.708659 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b40d9ec4-6f64-42ff-b418-41afff4c3716 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:01.709181 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b40d9ec4-6f64-42ff-b418-41afff4c3716 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:01.710045 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b40d9ec4-6f64-42ff-b418-41afff4c3716 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:01.710544 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b40d9ec4-6f64-42ff-b418-41afff4c3716 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:01.887053 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.objects.instance [None req-b40d9ec4-6f64-42ff-b418-41afff4c3716 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lazy-loading 'services' on Instance uuid 318e31f6-3faa-466b-8733-aec0c90a30bd {{(pid=99511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 15 20:04:02.026965 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b40d9ec4-6f64-42ff-b418-41afff4c3716 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "DELETE /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd/os-volume_attachments/494e2274-6797-4dba-909c-491149ac698d" status: 202 len: 0 microversion: 2.1 time: 0.331750 Apr 15 20:04:02.027640 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 637/1202] 10.222.0.58 () {58 vars in 1406 bytes} [Thu Apr 15 20:04:01 2021] DELETE /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd/os-volume_attachments/494e2274-6797-4dba-909c-491149ac698d => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:04:06.666877 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-5dd88042-b2a0-4745-8f8b-8d97036abf4a tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1550893985", "imageRef": "10d66d6e-f687-4228-93d1-67502c9b42e2", "flavorRef": "452", "networks": [{"uuid": "19b452bb-c309-496d-a8d9-d08c6427af14"}]}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:04:06.737690 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.network.neutron [None req-5dd88042-b2a0-4745-8f8b-8d97036abf4a tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] validate_networks() for [('19b452bb-c309-496d-a8d9-d08c6427af14', None, None, None)] {{(pid=99512) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 15 20:04:07.310646 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-5dd88042-b2a0-4745-8f8b-8d97036abf4a tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Flavor limits 0:0:0 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 15 20:04:07.311117 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-5dd88042-b2a0-4745-8f8b-8d97036abf4a tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Image limits 0:0:0 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 15 20:04:07.311745 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-5dd88042-b2a0-4745-8f8b-8d97036abf4a tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Flavor pref 0:0:0 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 15 20:04:07.312201 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-5dd88042-b2a0-4745-8f8b-8d97036abf4a tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Image pref 0:0:0 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 15 20:04:07.312658 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-5dd88042-b2a0-4745-8f8b-8d97036abf4a tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 15 20:04:07.321831 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5dd88042-b2a0-4745-8f8b-8d97036abf4a tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:07.322339 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5dd88042-b2a0-4745-8f8b-8d97036abf4a tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:07.323206 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5dd88042-b2a0-4745-8f8b-8d97036abf4a tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:07.323749 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5dd88042-b2a0-4745-8f8b-8d97036abf4a tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:07.342184 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-5dd88042-b2a0-4745-8f8b-8d97036abf4a tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Getting quotas for project 44df2d570f634a79887bd48d6c2ec9ef. Resources: {'cores', 'instances', 'ram'} {{(pid=99512) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 15 20:04:07.347004 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-5dd88042-b2a0-4745-8f8b-8d97036abf4a tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Getting quotas for user d710976383134829a1f71d1a1b5a2a5f and project 44df2d570f634a79887bd48d6c2ec9ef. Resources: {'cores', 'instances', 'ram'} {{(pid=99512) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 15 20:04:07.357976 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-5dd88042-b2a0-4745-8f8b-8d97036abf4a tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Going to run 1 instances... {{(pid=99512) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 15 20:04:07.360606 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-5dd88042-b2a0-4745-8f8b-8d97036abf4a tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 81a5e60e-1bef-416f-b351-17f3b362a8fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='10d66d6e-f687-4228-93d1-67502c9b42e2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 15 20:04:07.409774 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-5dd88042-b2a0-4745-8f8b-8d97036abf4a tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.746875 Apr 15 20:04:07.415891 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 566/1203] 10.222.0.58 () {60 vars in 1137 bytes} [Thu Apr 15 20:04:06 2021] POST /compute/v2.1/servers => generated 380 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 15 20:04:07.421902 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a37d864d-ba41-46fd-9606-41b716eca43b tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:04:07.422703 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a37d864d-ba41-46fd-9606-41b716eca43b tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 81a5e60e-1bef-416f-b351-17f3b362a8fa] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:04:07.500801 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a37d864d-ba41-46fd-9606-41b716eca43b tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:04:07.509036 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a37d864d-ba41-46fd-9606-41b716eca43b tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa" status: 200 len: 1218 microversion: 2.1 time: 0.091594 Apr 15 20:04:07.509654 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 638/1204] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:04:07 2021] GET /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:04:08.527765 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-64181b90-128b-4910-9f13-f7b3ecebc26f tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:04:08.528435 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-64181b90-128b-4910-9f13-f7b3ecebc26f tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 81a5e60e-1bef-416f-b351-17f3b362a8fa] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:04:08.537466 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-64181b90-128b-4910-9f13-f7b3ecebc26f tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:08.538023 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-64181b90-128b-4910-9f13-f7b3ecebc26f tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:08.538863 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-64181b90-128b-4910-9f13-f7b3ecebc26f tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:08.539386 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-64181b90-128b-4910-9f13-f7b3ecebc26f tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:08.801393 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-64181b90-128b-4910-9f13-f7b3ecebc26f tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:04:08.810128 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-64181b90-128b-4910-9f13-f7b3ecebc26f tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa" status: 200 len: 1222 microversion: 2.1 time: 0.286499 Apr 15 20:04:08.810748 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 567/1205] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:04:08 2021] GET /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa => generated 1222 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:04:09.828213 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-cfac77c0-fe19-49bf-81fb-d597d26c4fe0 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:04:09.828890 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-cfac77c0-fe19-49bf-81fb-d597d26c4fe0 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 81a5e60e-1bef-416f-b351-17f3b362a8fa] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:04:09.837690 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cfac77c0-fe19-49bf-81fb-d597d26c4fe0 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:09.838203 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cfac77c0-fe19-49bf-81fb-d597d26c4fe0 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:09.839040 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cfac77c0-fe19-49bf-81fb-d597d26c4fe0 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:09.839560 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cfac77c0-fe19-49bf-81fb-d597d26c4fe0 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:09.964246 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-cfac77c0-fe19-49bf-81fb-d597d26c4fe0 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:04:09.973582 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-cfac77c0-fe19-49bf-81fb-d597d26c4fe0 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa" status: 200 len: 1214 microversion: 2.1 time: 0.149488 Apr 15 20:04:09.974209 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 639/1206] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:04:09 2021] GET /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa => generated 1214 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:04:10.992286 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-dbfe472e-bc75-4ec9-8e1a-0e46b0e7ff33 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:04:10.992859 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-dbfe472e-bc75-4ec9-8e1a-0e46b0e7ff33 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 81a5e60e-1bef-416f-b351-17f3b362a8fa] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:04:11.001349 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dbfe472e-bc75-4ec9-8e1a-0e46b0e7ff33 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:11.001853 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dbfe472e-bc75-4ec9-8e1a-0e46b0e7ff33 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:11.002682 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dbfe472e-bc75-4ec9-8e1a-0e46b0e7ff33 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:11.003173 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dbfe472e-bc75-4ec9-8e1a-0e46b0e7ff33 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:11.127386 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-dbfe472e-bc75-4ec9-8e1a-0e46b0e7ff33 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:04:11.136334 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-dbfe472e-bc75-4ec9-8e1a-0e46b0e7ff33 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa" status: 200 len: 1214 microversion: 2.1 time: 0.148226 Apr 15 20:04:11.136951 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 568/1207] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:04:10 2021] GET /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa => generated 1214 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:04:12.154656 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-33890f46-7b0c-4b0d-8338-e82a7e711778 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:04:12.155341 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-33890f46-7b0c-4b0d-8338-e82a7e711778 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 81a5e60e-1bef-416f-b351-17f3b362a8fa] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:04:12.164198 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-33890f46-7b0c-4b0d-8338-e82a7e711778 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:12.164707 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-33890f46-7b0c-4b0d-8338-e82a7e711778 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:12.165569 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-33890f46-7b0c-4b0d-8338-e82a7e711778 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:12.166060 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-33890f46-7b0c-4b0d-8338-e82a7e711778 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:12.477879 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-33890f46-7b0c-4b0d-8338-e82a7e711778 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:04:12.487604 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-33890f46-7b0c-4b0d-8338-e82a7e711778 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa" status: 200 len: 1276 microversion: 2.1 time: 0.337094 Apr 15 20:04:12.488237 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 640/1208] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:04:12 2021] GET /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa => generated 1276 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:04:13.506934 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-08647777-2f7f-42d9-b755-767562817c63 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:04:13.507588 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-08647777-2f7f-42d9-b755-767562817c63 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 81a5e60e-1bef-416f-b351-17f3b362a8fa] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:04:13.515740 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-08647777-2f7f-42d9-b755-767562817c63 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:13.516785 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-08647777-2f7f-42d9-b755-767562817c63 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:13.517639 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-08647777-2f7f-42d9-b755-767562817c63 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:13.518134 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-08647777-2f7f-42d9-b755-767562817c63 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:13.751315 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-08647777-2f7f-42d9-b755-767562817c63 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:04:13.760526 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-08647777-2f7f-42d9-b755-767562817c63 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa" status: 200 len: 1318 microversion: 2.1 time: 0.257780 Apr 15 20:04:13.761095 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 569/1209] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:04:13 2021] GET /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:04:14.777849 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ee6900d6-0ccd-4bc0-a971-5fb35ca41380 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:04:14.778522 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ee6900d6-0ccd-4bc0-a971-5fb35ca41380 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 81a5e60e-1bef-416f-b351-17f3b362a8fa] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:04:14.787607 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ee6900d6-0ccd-4bc0-a971-5fb35ca41380 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:14.788123 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ee6900d6-0ccd-4bc0-a971-5fb35ca41380 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:14.788970 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ee6900d6-0ccd-4bc0-a971-5fb35ca41380 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:14.789464 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ee6900d6-0ccd-4bc0-a971-5fb35ca41380 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:15.227177 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-ee6900d6-0ccd-4bc0-a971-5fb35ca41380 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:04:15.236666 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ee6900d6-0ccd-4bc0-a971-5fb35ca41380 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa" status: 200 len: 1318 microversion: 2.1 time: 0.462927 Apr 15 20:04:15.237294 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 641/1210] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:04:14 2021] GET /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa => generated 1318 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:04:15.299162 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-33797e68-6e3f-47b9-b7e3-900e2b8e0de5 req-a58ac3ae-840a-4a20-996a-7a781309b44d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81a5e60e-1bef-416f-b351-17f3b362a8fa", "tag": "02fef566-85b2-46e5-8c69-a91ebf0f8fe7"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:04:15.301033 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:04:15.301033 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:04:15.309751 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-33797e68-6e3f-47b9-b7e3-900e2b8e0de5 req-a58ac3ae-840a-4a20-996a-7a781309b44d service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:15.310248 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-33797e68-6e3f-47b9-b7e3-900e2b8e0de5 req-a58ac3ae-840a-4a20-996a-7a781309b44d service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:15.329641 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-33797e68-6e3f-47b9-b7e3-900e2b8e0de5 req-a58ac3ae-840a-4a20-996a-7a781309b44d service nova] Creating event network-changed:02fef566-85b2-46e5-8c69-a91ebf0f8fe7 for instance 81a5e60e-1bef-416f-b351-17f3b362a8fa on hv-cinder-78638 Apr 15 20:04:15.334653 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-33797e68-6e3f-47b9-b7e3-900e2b8e0de5 req-a58ac3ae-840a-4a20-996a-7a781309b44d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040001 Apr 15 20:04:15.335291 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 570/1211] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:04:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:04:16.254099 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-2aeb66d2-cd81-4d6b-a357-165b7d478cce tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:04:16.254773 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-2aeb66d2-cd81-4d6b-a357-165b7d478cce tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 81a5e60e-1bef-416f-b351-17f3b362a8fa] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:04:16.262714 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2aeb66d2-cd81-4d6b-a357-165b7d478cce tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:16.263226 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2aeb66d2-cd81-4d6b-a357-165b7d478cce tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:16.264090 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2aeb66d2-cd81-4d6b-a357-165b7d478cce tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:16.264587 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2aeb66d2-cd81-4d6b-a357-165b7d478cce tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:16.475194 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-2aeb66d2-cd81-4d6b-a357-165b7d478cce tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:04:16.483989 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-2aeb66d2-cd81-4d6b-a357-165b7d478cce tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa" status: 200 len: 1318 microversion: 2.1 time: 0.233832 Apr 15 20:04:16.484556 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 642/1212] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:04:16 2021] GET /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:04:17.502487 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-54efc4ed-761e-45dd-85f5-7d38a2fc673b tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:04:17.503248 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-54efc4ed-761e-45dd-85f5-7d38a2fc673b tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 81a5e60e-1bef-416f-b351-17f3b362a8fa] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:04:17.512172 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-54efc4ed-761e-45dd-85f5-7d38a2fc673b tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:17.512685 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-54efc4ed-761e-45dd-85f5-7d38a2fc673b tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:17.513523 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-54efc4ed-761e-45dd-85f5-7d38a2fc673b tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:17.514009 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-54efc4ed-761e-45dd-85f5-7d38a2fc673b tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:18.116771 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-54efc4ed-761e-45dd-85f5-7d38a2fc673b tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:04:18.126147 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-54efc4ed-761e-45dd-85f5-7d38a2fc673b tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa" status: 200 len: 1318 microversion: 2.1 time: 0.628154 Apr 15 20:04:18.126763 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 571/1213] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:04:17 2021] GET /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa => generated 1318 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:04:19.144472 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-aac5b831-1395-4799-b168-b12525490ea1 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:04:19.145089 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-aac5b831-1395-4799-b168-b12525490ea1 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 81a5e60e-1bef-416f-b351-17f3b362a8fa] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:04:19.153037 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-aac5b831-1395-4799-b168-b12525490ea1 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:19.153549 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-aac5b831-1395-4799-b168-b12525490ea1 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:19.154394 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-aac5b831-1395-4799-b168-b12525490ea1 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:19.154887 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-aac5b831-1395-4799-b168-b12525490ea1 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:19.369261 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-aac5b831-1395-4799-b168-b12525490ea1 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:04:19.378511 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-aac5b831-1395-4799-b168-b12525490ea1 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa" status: 200 len: 1318 microversion: 2.1 time: 0.238545 Apr 15 20:04:19.379126 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 643/1214] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:04:19 2021] GET /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:04:20.395779 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-3139b181-31a1-40f2-8dd1-b9431f38622e tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:04:20.396432 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-3139b181-31a1-40f2-8dd1-b9431f38622e tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 81a5e60e-1bef-416f-b351-17f3b362a8fa] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:04:20.404311 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3139b181-31a1-40f2-8dd1-b9431f38622e tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:20.404821 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3139b181-31a1-40f2-8dd1-b9431f38622e tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:20.405643 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3139b181-31a1-40f2-8dd1-b9431f38622e tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:20.406136 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3139b181-31a1-40f2-8dd1-b9431f38622e tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:20.620482 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3139b181-31a1-40f2-8dd1-b9431f38622e tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:04:20.629903 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-3139b181-31a1-40f2-8dd1-b9431f38622e tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa" status: 200 len: 1318 microversion: 2.1 time: 0.238243 Apr 15 20:04:20.630527 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 572/1215] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:04:20 2021] GET /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:04:21.649343 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-cd62b9e4-822e-4dc4-852b-720762929152 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:04:21.650016 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-cd62b9e4-822e-4dc4-852b-720762929152 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 81a5e60e-1bef-416f-b351-17f3b362a8fa] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:04:21.657905 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cd62b9e4-822e-4dc4-852b-720762929152 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:21.658416 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cd62b9e4-822e-4dc4-852b-720762929152 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:21.659252 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cd62b9e4-822e-4dc4-852b-720762929152 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:21.659774 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cd62b9e4-822e-4dc4-852b-720762929152 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:21.872192 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-cd62b9e4-822e-4dc4-852b-720762929152 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:04:21.881502 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-cd62b9e4-822e-4dc4-852b-720762929152 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa" status: 200 len: 1318 microversion: 2.1 time: 0.236670 Apr 15 20:04:21.882136 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 644/1216] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:04:21 2021] GET /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:04:22.899869 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-0b03c1f9-0dfc-43e3-91b9-4521beb64b0e tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:04:22.900537 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-0b03c1f9-0dfc-43e3-91b9-4521beb64b0e tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 81a5e60e-1bef-416f-b351-17f3b362a8fa] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:04:22.908263 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0b03c1f9-0dfc-43e3-91b9-4521beb64b0e tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:22.908766 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0b03c1f9-0dfc-43e3-91b9-4521beb64b0e tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:22.909590 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0b03c1f9-0dfc-43e3-91b9-4521beb64b0e tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:22.910336 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0b03c1f9-0dfc-43e3-91b9-4521beb64b0e tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:23.127941 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-0b03c1f9-0dfc-43e3-91b9-4521beb64b0e tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:04:23.136592 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-0b03c1f9-0dfc-43e3-91b9-4521beb64b0e tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa" status: 200 len: 1318 microversion: 2.1 time: 0.240885 Apr 15 20:04:23.137205 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 573/1217] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:04:22 2021] GET /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:04:24.155446 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e6ba6397-ee45-44ca-8da5-eecabacb9190 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:04:24.156210 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e6ba6397-ee45-44ca-8da5-eecabacb9190 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 81a5e60e-1bef-416f-b351-17f3b362a8fa] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:04:24.165161 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e6ba6397-ee45-44ca-8da5-eecabacb9190 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:24.165761 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e6ba6397-ee45-44ca-8da5-eecabacb9190 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:24.166682 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e6ba6397-ee45-44ca-8da5-eecabacb9190 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:24.167294 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e6ba6397-ee45-44ca-8da5-eecabacb9190 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:24.377121 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-e6ba6397-ee45-44ca-8da5-eecabacb9190 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:04:24.386015 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e6ba6397-ee45-44ca-8da5-eecabacb9190 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa" status: 200 len: 1318 microversion: 2.1 time: 0.234811 Apr 15 20:04:24.386672 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 645/1218] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:04:24 2021] GET /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:04:24.803324 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-8fcc9904-05be-4a38-876e-5669918bde8b req-826201ca-4781-4514-8975-11e005d09000 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81a5e60e-1bef-416f-b351-17f3b362a8fa", "name": "network-vif-plugged", "status": "completed", "tag": "02fef566-85b2-46e5-8c69-a91ebf0f8fe7"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:04:24.805372 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:04:24.805372 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:04:24.815720 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-8fcc9904-05be-4a38-876e-5669918bde8b req-826201ca-4781-4514-8975-11e005d09000 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:24.816337 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-8fcc9904-05be-4a38-876e-5669918bde8b req-826201ca-4781-4514-8975-11e005d09000 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:24.836076 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-8fcc9904-05be-4a38-876e-5669918bde8b req-826201ca-4781-4514-8975-11e005d09000 service nova] Creating event network-vif-plugged:02fef566-85b2-46e5-8c69-a91ebf0f8fe7 for instance 81a5e60e-1bef-416f-b351-17f3b362a8fa on hv-cinder-78638 Apr 15 20:04:24.841527 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-8fcc9904-05be-4a38-876e-5669918bde8b req-826201ca-4781-4514-8975-11e005d09000 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042398 Apr 15 20:04:24.842357 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 574/1219] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:04:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:04:25.404696 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e9df8150-bd28-4e6e-8140-51e60a7a6bbb tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:04:25.405291 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e9df8150-bd28-4e6e-8140-51e60a7a6bbb tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 81a5e60e-1bef-416f-b351-17f3b362a8fa] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:04:25.413864 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e9df8150-bd28-4e6e-8140-51e60a7a6bbb tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:25.414365 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e9df8150-bd28-4e6e-8140-51e60a7a6bbb tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:25.415189 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e9df8150-bd28-4e6e-8140-51e60a7a6bbb tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:25.415703 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e9df8150-bd28-4e6e-8140-51e60a7a6bbb tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:25.622946 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-e9df8150-bd28-4e6e-8140-51e60a7a6bbb tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:04:25.631862 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e9df8150-bd28-4e6e-8140-51e60a7a6bbb tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa" status: 200 len: 1318 microversion: 2.1 time: 0.231253 Apr 15 20:04:25.632707 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 646/1220] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:04:25 2021] GET /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:04:26.650412 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-33e73305-efa7-44ac-8f78-96891eb5b193 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:04:26.651312 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-33e73305-efa7-44ac-8f78-96891eb5b193 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 81a5e60e-1bef-416f-b351-17f3b362a8fa] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:04:26.659303 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-33e73305-efa7-44ac-8f78-96891eb5b193 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:26.659824 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-33e73305-efa7-44ac-8f78-96891eb5b193 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:26.660900 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-33e73305-efa7-44ac-8f78-96891eb5b193 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:26.661389 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-33e73305-efa7-44ac-8f78-96891eb5b193 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:26.873560 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-33e73305-efa7-44ac-8f78-96891eb5b193 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:04:26.882476 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-33e73305-efa7-44ac-8f78-96891eb5b193 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa" status: 200 len: 1509 microversion: 2.1 time: 0.236684 Apr 15 20:04:26.883095 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 575/1221] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:04:26 2021] GET /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa => generated 1509 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:04:28.389010 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-8ce3148f-77c4-4ada-94e3-2d2fc2931d6a tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a53ba322-5f31-448b-b977-ea891fb7d645"}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:04:28.390258 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-8ce3148f-77c4-4ada-94e3-2d2fc2931d6a tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 81a5e60e-1bef-416f-b351-17f3b362a8fa] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:04:28.399173 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8ce3148f-77c4-4ada-94e3-2d2fc2931d6a tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:28.399727 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8ce3148f-77c4-4ada-94e3-2d2fc2931d6a tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:28.400567 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8ce3148f-77c4-4ada-94e3-2d2fc2931d6a tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:28.401055 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8ce3148f-77c4-4ada-94e3-2d2fc2931d6a tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:28.777454 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-8ce3148f-77c4-4ada-94e3-2d2fc2931d6a tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "POST /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.392297 Apr 15 20:04:28.778162 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 647/1222] 10.222.0.58 () {60 vars in 1313 bytes} [Thu Apr 15 20:04:28 2021] POST /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa/os-volume_attachments => generated 194 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:04:36.602940 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-2e4633aa-7a9d-440c-882c-adeb166aced9 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a53ba322-5f31-448b-b977-ea891fb7d645"}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:04:36.604183 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-2e4633aa-7a9d-440c-882c-adeb166aced9 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 81a5e60e-1bef-416f-b351-17f3b362a8fa] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:04:36.611976 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2e4633aa-7a9d-440c-882c-adeb166aced9 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:36.612479 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2e4633aa-7a9d-440c-882c-adeb166aced9 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:36.613307 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2e4633aa-7a9d-440c-882c-adeb166aced9 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:36.613794 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2e4633aa-7a9d-440c-882c-adeb166aced9 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:36.783449 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-2e4633aa-7a9d-440c-882c-adeb166aced9 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] HTTP exception thrown: Invalid volume: volume a53ba322-5f31-448b-b977-ea891fb7d645 is already attached to instances: 81a5e60e-1bef-416f-b351-17f3b362a8fa Apr 15 20:04:36.784123 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-2e4633aa-7a9d-440c-882c-adeb166aced9 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Returning 400 to user: Invalid volume: volume a53ba322-5f31-448b-b977-ea891fb7d645 is already attached to instances: 81a5e60e-1bef-416f-b351-17f3b362a8fa {{(pid=99512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 20:04:36.785270 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-2e4633aa-7a9d-440c-882c-adeb166aced9 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "POST /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.186384 Apr 15 20:04:36.785874 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 576/1223] 10.222.0.58 () {60 vars in 1313 bytes} [Thu Apr 15 20:04:36 2021] POST /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa/os-volume_attachments => generated 174 bytes in 188 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 15 20:04:36.900854 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-cb685bb6-f201-4515-a9c8-449af9ee0d56 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:04:36.901581 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-cb685bb6-f201-4515-a9c8-449af9ee0d56 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 81a5e60e-1bef-416f-b351-17f3b362a8fa] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:04:36.911016 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cb685bb6-f201-4515-a9c8-449af9ee0d56 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:36.911549 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cb685bb6-f201-4515-a9c8-449af9ee0d56 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:36.913132 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cb685bb6-f201-4515-a9c8-449af9ee0d56 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:36.913625 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cb685bb6-f201-4515-a9c8-449af9ee0d56 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:37.085623 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.objects.instance [None req-cb685bb6-f201-4515-a9c8-449af9ee0d56 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lazy-loading 'services' on Instance uuid 81a5e60e-1bef-416f-b351-17f3b362a8fa {{(pid=99511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 15 20:04:37.227429 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-cb685bb6-f201-4515-a9c8-449af9ee0d56 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "DELETE /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa/os-volume_attachments/a53ba322-5f31-448b-b977-ea891fb7d645" status: 202 len: 0 microversion: 2.1 time: 0.332021 Apr 15 20:04:37.228073 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 648/1224] 10.222.0.58 () {58 vars in 1406 bytes} [Thu Apr 15 20:04:36 2021] DELETE /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa/os-volume_attachments/a53ba322-5f31-448b-b977-ea891fb7d645 => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:04:38.551692 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-5bc06ea7-490d-427d-897e-6b1ba8073429 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1645901781", "imageRef": "10d66d6e-f687-4228-93d1-67502c9b42e2", "flavorRef": "452", "networks": [{"uuid": "19b452bb-c309-496d-a8d9-d08c6427af14"}]}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:04:38.622202 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.network.neutron [None req-5bc06ea7-490d-427d-897e-6b1ba8073429 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] validate_networks() for [('19b452bb-c309-496d-a8d9-d08c6427af14', None, None, None)] {{(pid=99512) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 15 20:04:39.314723 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-5bc06ea7-490d-427d-897e-6b1ba8073429 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Flavor limits 0:0:0 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 15 20:04:39.315201 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-5bc06ea7-490d-427d-897e-6b1ba8073429 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Image limits 0:0:0 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 15 20:04:39.315793 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-5bc06ea7-490d-427d-897e-6b1ba8073429 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Flavor pref 0:0:0 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 15 20:04:39.316264 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-5bc06ea7-490d-427d-897e-6b1ba8073429 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Image pref 0:0:0 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 15 20:04:39.316732 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-5bc06ea7-490d-427d-897e-6b1ba8073429 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 15 20:04:39.326999 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5bc06ea7-490d-427d-897e-6b1ba8073429 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:39.327573 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5bc06ea7-490d-427d-897e-6b1ba8073429 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:39.328463 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5bc06ea7-490d-427d-897e-6b1ba8073429 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:39.328968 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-5bc06ea7-490d-427d-897e-6b1ba8073429 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:39.347310 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-5bc06ea7-490d-427d-897e-6b1ba8073429 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Getting quotas for project 44df2d570f634a79887bd48d6c2ec9ef. Resources: {'cores', 'instances', 'ram'} {{(pid=99512) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 15 20:04:39.351724 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-5bc06ea7-490d-427d-897e-6b1ba8073429 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Getting quotas for user d710976383134829a1f71d1a1b5a2a5f and project 44df2d570f634a79887bd48d6c2ec9ef. Resources: {'cores', 'instances', 'ram'} {{(pid=99512) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 15 20:04:39.363543 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-5bc06ea7-490d-427d-897e-6b1ba8073429 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Going to run 1 instances... {{(pid=99512) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 15 20:04:39.366311 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-5bc06ea7-490d-427d-897e-6b1ba8073429 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 13627154-f64a-4efd-a8af-07fd741b1e7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='10d66d6e-f687-4228-93d1-67502c9b42e2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 15 20:04:39.420086 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-5bc06ea7-490d-427d-897e-6b1ba8073429 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.872487 Apr 15 20:04:39.421337 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 577/1225] 10.222.0.58 () {60 vars in 1137 bytes} [Thu Apr 15 20:04:38 2021] POST /compute/v2.1/servers => generated 380 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 15 20:04:39.433198 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-bad5f749-4cb3-4c8f-9d94-01054a11a99a tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:04:39.433980 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-bad5f749-4cb3-4c8f-9d94-01054a11a99a tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 13627154-f64a-4efd-a8af-07fd741b1e7f] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:04:39.522313 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-bad5f749-4cb3-4c8f-9d94-01054a11a99a tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:04:39.530525 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-bad5f749-4cb3-4c8f-9d94-01054a11a99a tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/13627154-f64a-4efd-a8af-07fd741b1e7f" status: 200 len: 1218 microversion: 2.1 time: 0.102338 Apr 15 20:04:39.531146 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 649/1226] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:04:39 2021] GET /compute/v2.1/servers/13627154-f64a-4efd-a8af-07fd741b1e7f => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:04:40.548875 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-8402013c-3d92-4a46-8867-f9d81ab36699 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:04:40.549534 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-8402013c-3d92-4a46-8867-f9d81ab36699 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 13627154-f64a-4efd-a8af-07fd741b1e7f] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:04:40.558316 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8402013c-3d92-4a46-8867-f9d81ab36699 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:40.558836 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8402013c-3d92-4a46-8867-f9d81ab36699 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:40.559793 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8402013c-3d92-4a46-8867-f9d81ab36699 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:40.560286 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8402013c-3d92-4a46-8867-f9d81ab36699 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:40.754620 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-8402013c-3d92-4a46-8867-f9d81ab36699 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:04:40.764222 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-8402013c-3d92-4a46-8867-f9d81ab36699 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/13627154-f64a-4efd-a8af-07fd741b1e7f" status: 200 len: 1288 microversion: 2.1 time: 0.219426 Apr 15 20:04:40.764860 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 578/1227] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:04:40 2021] GET /compute/v2.1/servers/13627154-f64a-4efd-a8af-07fd741b1e7f => generated 1288 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:04:41.782280 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-cbe66904-3b83-4877-a798-a0a67c2e6931 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:04:41.782952 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-cbe66904-3b83-4877-a798-a0a67c2e6931 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 13627154-f64a-4efd-a8af-07fd741b1e7f] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:04:41.792427 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cbe66904-3b83-4877-a798-a0a67c2e6931 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:41.792938 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cbe66904-3b83-4877-a798-a0a67c2e6931 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:41.793779 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cbe66904-3b83-4877-a798-a0a67c2e6931 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:41.794269 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cbe66904-3b83-4877-a798-a0a67c2e6931 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:42.303243 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-cbe66904-3b83-4877-a798-a0a67c2e6931 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:04:42.312564 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-cbe66904-3b83-4877-a798-a0a67c2e6931 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/13627154-f64a-4efd-a8af-07fd741b1e7f" status: 200 len: 1318 microversion: 2.1 time: 0.534278 Apr 15 20:04:42.313197 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 650/1228] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:04:41 2021] GET /compute/v2.1/servers/13627154-f64a-4efd-a8af-07fd741b1e7f => generated 1318 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:04:43.032018 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-bb733aa2-6e9f-4618-b5d7-7bb636b582b4 req-63c3c85a-3939-4639-bba5-b2f71957551d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13627154-f64a-4efd-a8af-07fd741b1e7f", "tag": "bd211326-571f-4b1f-a530-fddff9b0f835"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:04:43.033972 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:04:43.033972 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:04:43.043261 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-bb733aa2-6e9f-4618-b5d7-7bb636b582b4 req-63c3c85a-3939-4639-bba5-b2f71957551d service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:43.043882 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-bb733aa2-6e9f-4618-b5d7-7bb636b582b4 req-63c3c85a-3939-4639-bba5-b2f71957551d service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:43.062079 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-bb733aa2-6e9f-4618-b5d7-7bb636b582b4 req-63c3c85a-3939-4639-bba5-b2f71957551d service nova] Creating event network-changed:bd211326-571f-4b1f-a530-fddff9b0f835 for instance 13627154-f64a-4efd-a8af-07fd741b1e7f on hv-cinder-78638 Apr 15 20:04:43.067120 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-bb733aa2-6e9f-4618-b5d7-7bb636b582b4 req-63c3c85a-3939-4639-bba5-b2f71957551d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039047 Apr 15 20:04:43.067830 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 579/1229] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:04:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:04:43.330786 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e2d7713e-d40d-4fcd-ab41-93a6b1d8fa11 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:04:43.331603 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e2d7713e-d40d-4fcd-ab41-93a6b1d8fa11 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 13627154-f64a-4efd-a8af-07fd741b1e7f] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:04:43.339544 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e2d7713e-d40d-4fcd-ab41-93a6b1d8fa11 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:43.340052 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e2d7713e-d40d-4fcd-ab41-93a6b1d8fa11 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:43.340894 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e2d7713e-d40d-4fcd-ab41-93a6b1d8fa11 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:43.341382 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e2d7713e-d40d-4fcd-ab41-93a6b1d8fa11 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:43.964831 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-e2d7713e-d40d-4fcd-ab41-93a6b1d8fa11 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:04:43.973911 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e2d7713e-d40d-4fcd-ab41-93a6b1d8fa11 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/13627154-f64a-4efd-a8af-07fd741b1e7f" status: 200 len: 1318 microversion: 2.1 time: 0.647097 Apr 15 20:04:43.974441 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 651/1230] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:04:43 2021] GET /compute/v2.1/servers/13627154-f64a-4efd-a8af-07fd741b1e7f => generated 1318 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:04:44.994224 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c5a50aef-d168-41f4-b7e6-a5952a8ea7b8 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:04:44.994911 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c5a50aef-d168-41f4-b7e6-a5952a8ea7b8 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 13627154-f64a-4efd-a8af-07fd741b1e7f] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:04:45.003001 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c5a50aef-d168-41f4-b7e6-a5952a8ea7b8 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:45.003567 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c5a50aef-d168-41f4-b7e6-a5952a8ea7b8 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:45.004407 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c5a50aef-d168-41f4-b7e6-a5952a8ea7b8 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:45.004902 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c5a50aef-d168-41f4-b7e6-a5952a8ea7b8 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:45.223014 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c5a50aef-d168-41f4-b7e6-a5952a8ea7b8 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:04:45.231960 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c5a50aef-d168-41f4-b7e6-a5952a8ea7b8 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/13627154-f64a-4efd-a8af-07fd741b1e7f" status: 200 len: 1318 microversion: 2.1 time: 0.242655 Apr 15 20:04:45.232586 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 580/1231] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:04:44 2021] GET /compute/v2.1/servers/13627154-f64a-4efd-a8af-07fd741b1e7f => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:04:46.250368 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-373bae31-fdd6-4529-9373-dda28ae3c4e6 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:04:46.251041 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-373bae31-fdd6-4529-9373-dda28ae3c4e6 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 13627154-f64a-4efd-a8af-07fd741b1e7f] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:04:46.259456 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-373bae31-fdd6-4529-9373-dda28ae3c4e6 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:46.259972 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-373bae31-fdd6-4529-9373-dda28ae3c4e6 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:46.260812 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-373bae31-fdd6-4529-9373-dda28ae3c4e6 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:46.261310 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-373bae31-fdd6-4529-9373-dda28ae3c4e6 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:46.488472 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-373bae31-fdd6-4529-9373-dda28ae3c4e6 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:04:46.497529 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-373bae31-fdd6-4529-9373-dda28ae3c4e6 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/13627154-f64a-4efd-a8af-07fd741b1e7f" status: 200 len: 1318 microversion: 2.1 time: 0.251544 Apr 15 20:04:46.498155 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 652/1232] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:04:46 2021] GET /compute/v2.1/servers/13627154-f64a-4efd-a8af-07fd741b1e7f => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:04:47.516608 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-3e3ed63f-6f08-4e6c-b169-8c963fe5a0ac tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:04:47.517296 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-3e3ed63f-6f08-4e6c-b169-8c963fe5a0ac tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 13627154-f64a-4efd-a8af-07fd741b1e7f] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:04:47.525309 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3e3ed63f-6f08-4e6c-b169-8c963fe5a0ac tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:47.525863 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3e3ed63f-6f08-4e6c-b169-8c963fe5a0ac tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:47.526710 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3e3ed63f-6f08-4e6c-b169-8c963fe5a0ac tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:47.527204 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3e3ed63f-6f08-4e6c-b169-8c963fe5a0ac tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:47.747979 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3e3ed63f-6f08-4e6c-b169-8c963fe5a0ac tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:04:47.756820 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-3e3ed63f-6f08-4e6c-b169-8c963fe5a0ac tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/13627154-f64a-4efd-a8af-07fd741b1e7f" status: 200 len: 1318 microversion: 2.1 time: 0.244511 Apr 15 20:04:47.757462 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 581/1233] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:04:47 2021] GET /compute/v2.1/servers/13627154-f64a-4efd-a8af-07fd741b1e7f => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:04:48.775335 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-62e62dbb-ade3-4b09-adcd-080f65508730 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:04:48.776003 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-62e62dbb-ade3-4b09-adcd-080f65508730 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 13627154-f64a-4efd-a8af-07fd741b1e7f] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:04:48.783799 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-62e62dbb-ade3-4b09-adcd-080f65508730 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:48.784303 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-62e62dbb-ade3-4b09-adcd-080f65508730 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:48.785394 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-62e62dbb-ade3-4b09-adcd-080f65508730 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:48.785883 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-62e62dbb-ade3-4b09-adcd-080f65508730 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:49.003142 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-62e62dbb-ade3-4b09-adcd-080f65508730 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:04:49.012752 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-62e62dbb-ade3-4b09-adcd-080f65508730 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/13627154-f64a-4efd-a8af-07fd741b1e7f" status: 200 len: 1318 microversion: 2.1 time: 0.241406 Apr 15 20:04:49.013372 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 653/1234] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:04:48 2021] GET /compute/v2.1/servers/13627154-f64a-4efd-a8af-07fd741b1e7f => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:04:50.031316 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a5a8ca98-c93f-4688-89b8-d421f1859ec0 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:04:50.031918 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a5a8ca98-c93f-4688-89b8-d421f1859ec0 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 13627154-f64a-4efd-a8af-07fd741b1e7f] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:04:50.040200 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a5a8ca98-c93f-4688-89b8-d421f1859ec0 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:50.040710 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a5a8ca98-c93f-4688-89b8-d421f1859ec0 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:50.041543 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a5a8ca98-c93f-4688-89b8-d421f1859ec0 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:50.042034 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a5a8ca98-c93f-4688-89b8-d421f1859ec0 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:50.269057 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a5a8ca98-c93f-4688-89b8-d421f1859ec0 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:04:50.278012 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a5a8ca98-c93f-4688-89b8-d421f1859ec0 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/13627154-f64a-4efd-a8af-07fd741b1e7f" status: 200 len: 1318 microversion: 2.1 time: 0.250857 Apr 15 20:04:50.278630 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 582/1235] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:04:50 2021] GET /compute/v2.1/servers/13627154-f64a-4efd-a8af-07fd741b1e7f => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:04:50.935185 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-e4d9294c-31be-4501-817b-2d436b927a88 req-f26ebdc2-b5c3-4f0a-8cac-eea0176e328d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13627154-f64a-4efd-a8af-07fd741b1e7f", "name": "network-vif-plugged", "status": "completed", "tag": "bd211326-571f-4b1f-a530-fddff9b0f835"}]} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:04:50.937086 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:04:50.937086 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:04:50.946581 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-e4d9294c-31be-4501-817b-2d436b927a88 req-f26ebdc2-b5c3-4f0a-8cac-eea0176e328d service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:50.947112 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-e4d9294c-31be-4501-817b-2d436b927a88 req-f26ebdc2-b5c3-4f0a-8cac-eea0176e328d service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:50.964840 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-e4d9294c-31be-4501-817b-2d436b927a88 req-f26ebdc2-b5c3-4f0a-8cac-eea0176e328d service nova] Creating event network-vif-plugged:bd211326-571f-4b1f-a530-fddff9b0f835 for instance 13627154-f64a-4efd-a8af-07fd741b1e7f on hv-cinder-78638 Apr 15 20:04:50.970089 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-e4d9294c-31be-4501-817b-2d436b927a88 req-f26ebdc2-b5c3-4f0a-8cac-eea0176e328d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039662 Apr 15 20:04:50.970732 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 654/1236] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:04:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:04:51.296886 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c3b62c4d-2867-4914-bc4c-016354718ead tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:04:51.297612 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c3b62c4d-2867-4914-bc4c-016354718ead tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 13627154-f64a-4efd-a8af-07fd741b1e7f] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:04:51.306027 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c3b62c4d-2867-4914-bc4c-016354718ead tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:51.306584 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c3b62c4d-2867-4914-bc4c-016354718ead tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:51.307485 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c3b62c4d-2867-4914-bc4c-016354718ead tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:51.307978 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c3b62c4d-2867-4914-bc4c-016354718ead tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:51.523099 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c3b62c4d-2867-4914-bc4c-016354718ead tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:04:51.533864 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c3b62c4d-2867-4914-bc4c-016354718ead tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/13627154-f64a-4efd-a8af-07fd741b1e7f" status: 200 len: 1318 microversion: 2.1 time: 0.240981 Apr 15 20:04:51.534507 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 583/1237] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:04:51 2021] GET /compute/v2.1/servers/13627154-f64a-4efd-a8af-07fd741b1e7f => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:04:52.553495 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7123301f-4fac-44ff-a38a-5891ad6f44a8 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:04:52.554340 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7123301f-4fac-44ff-a38a-5891ad6f44a8 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 13627154-f64a-4efd-a8af-07fd741b1e7f] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:04:52.563029 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7123301f-4fac-44ff-a38a-5891ad6f44a8 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:52.563596 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7123301f-4fac-44ff-a38a-5891ad6f44a8 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:52.564446 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7123301f-4fac-44ff-a38a-5891ad6f44a8 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:52.564943 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7123301f-4fac-44ff-a38a-5891ad6f44a8 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:52.784929 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-7123301f-4fac-44ff-a38a-5891ad6f44a8 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:04:52.793914 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7123301f-4fac-44ff-a38a-5891ad6f44a8 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/13627154-f64a-4efd-a8af-07fd741b1e7f" status: 200 len: 1508 microversion: 2.1 time: 0.245450 Apr 15 20:04:52.794538 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 655/1238] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:04:52 2021] GET /compute/v2.1/servers/13627154-f64a-4efd-a8af-07fd741b1e7f => generated 1508 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:04:54.322811 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-1b93bb56-561c-4f40-84b3-a9140b2409ff tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97367cb4-4c54-47e8-a138-7648be6e6c51"}} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:04:54.324105 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-1b93bb56-561c-4f40-84b3-a9140b2409ff tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 13627154-f64a-4efd-a8af-07fd741b1e7f] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:04:54.332169 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1b93bb56-561c-4f40-84b3-a9140b2409ff tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:54.332682 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1b93bb56-561c-4f40-84b3-a9140b2409ff tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:54.333612 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1b93bb56-561c-4f40-84b3-a9140b2409ff tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:04:54.334206 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1b93bb56-561c-4f40-84b3-a9140b2409ff tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:04:54.715303 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-1b93bb56-561c-4f40-84b3-a9140b2409ff tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "POST /compute/v2.1/servers/13627154-f64a-4efd-a8af-07fd741b1e7f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.397194 Apr 15 20:04:54.716842 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 584/1239] 10.222.0.58 () {60 vars in 1313 bytes} [Thu Apr 15 20:04:54 2021] POST /compute/v2.1/servers/13627154-f64a-4efd-a8af-07fd741b1e7f/os-volume_attachments => generated 194 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:05:02.737882 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6c828143-5ce0-48eb-9924-95d5b7dc3de7 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:05:02.738461 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6c828143-5ce0-48eb-9924-95d5b7dc3de7 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 13627154-f64a-4efd-a8af-07fd741b1e7f] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:05:02.747302 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6c828143-5ce0-48eb-9924-95d5b7dc3de7 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:02.747827 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6c828143-5ce0-48eb-9924-95d5b7dc3de7 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:02.748669 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6c828143-5ce0-48eb-9924-95d5b7dc3de7 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:02.749158 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6c828143-5ce0-48eb-9924-95d5b7dc3de7 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:02.939619 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.objects.instance [None req-6c828143-5ce0-48eb-9924-95d5b7dc3de7 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lazy-loading 'services' on Instance uuid 13627154-f64a-4efd-a8af-07fd741b1e7f {{(pid=99511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 15 20:05:03.080671 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6c828143-5ce0-48eb-9924-95d5b7dc3de7 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "DELETE /compute/v2.1/servers/13627154-f64a-4efd-a8af-07fd741b1e7f/os-volume_attachments/97367cb4-4c54-47e8-a138-7648be6e6c51" status: 202 len: 0 microversion: 2.1 time: 0.346687 Apr 15 20:05:03.082072 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 656/1240] 10.222.0.58 () {58 vars in 1406 bytes} [Thu Apr 15 20:05:02 2021] DELETE /compute/v2.1/servers/13627154-f64a-4efd-a8af-07fd741b1e7f/os-volume_attachments/97367cb4-4c54-47e8-a138-7648be6e6c51 => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:05:05.546577 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-fbe9f2b3-e2fc-4bfe-9308-7482175d28d9 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:05:05.547303 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-fbe9f2b3-e2fc-4bfe-9308-7482175d28d9 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 13627154-f64a-4efd-a8af-07fd741b1e7f] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:05:05.557138 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fbe9f2b3-e2fc-4bfe-9308-7482175d28d9 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:05.557646 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fbe9f2b3-e2fc-4bfe-9308-7482175d28d9 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:05.558480 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fbe9f2b3-e2fc-4bfe-9308-7482175d28d9 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:05.558966 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-fbe9f2b3-e2fc-4bfe-9308-7482175d28d9 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:05.629633 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-fbe9f2b3-e2fc-4bfe-9308-7482175d28d9 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 13627154-f64a-4efd-a8af-07fd741b1e7f] Going to try to terminate instance {{(pid=99512) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 15 20:05:05.748041 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-fbe9f2b3-e2fc-4bfe-9308-7482175d28d9 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "DELETE /compute/v2.1/servers/13627154-f64a-4efd-a8af-07fd741b1e7f" status: 204 len: 0 microversion: 2.1 time: 0.205577 Apr 15 20:05:05.749606 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 585/1241] 10.222.0.58 () {58 vars in 1229 bytes} [Thu Apr 15 20:05:05 2021] DELETE /compute/v2.1/servers/13627154-f64a-4efd-a8af-07fd741b1e7f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 15 20:05:05.758025 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-19254055-80a5-48dd-8a85-0d20dd751b11 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:05:05.758800 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-19254055-80a5-48dd-8a85-0d20dd751b11 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 13627154-f64a-4efd-a8af-07fd741b1e7f] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:05:05.766970 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-19254055-80a5-48dd-8a85-0d20dd751b11 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:05.767541 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-19254055-80a5-48dd-8a85-0d20dd751b11 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:05.768395 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-19254055-80a5-48dd-8a85-0d20dd751b11 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:05.768945 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-19254055-80a5-48dd-8a85-0d20dd751b11 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:05.986163 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-19254055-80a5-48dd-8a85-0d20dd751b11 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:05:05.995748 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-19254055-80a5-48dd-8a85-0d20dd751b11 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/13627154-f64a-4efd-a8af-07fd741b1e7f" status: 200 len: 1514 microversion: 2.1 time: 0.242265 Apr 15 20:05:05.996367 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 657/1242] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:05:05 2021] GET /compute/v2.1/servers/13627154-f64a-4efd-a8af-07fd741b1e7f => generated 1514 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:05:07.015553 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-54229164-cb2d-4793-9dea-0e785d1af98d tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:05:07.016253 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-54229164-cb2d-4793-9dea-0e785d1af98d tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 13627154-f64a-4efd-a8af-07fd741b1e7f] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:05:07.024218 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-54229164-cb2d-4793-9dea-0e785d1af98d tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:07.024728 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-54229164-cb2d-4793-9dea-0e785d1af98d tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:07.025569 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-54229164-cb2d-4793-9dea-0e785d1af98d tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:07.026062 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-54229164-cb2d-4793-9dea-0e785d1af98d tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:07.246146 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-54229164-cb2d-4793-9dea-0e785d1af98d tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:05:07.255137 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-54229164-cb2d-4793-9dea-0e785d1af98d tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/13627154-f64a-4efd-a8af-07fd741b1e7f" status: 200 len: 1514 microversion: 2.1 time: 0.244271 Apr 15 20:05:07.255787 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 586/1243] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:05:07 2021] GET /compute/v2.1/servers/13627154-f64a-4efd-a8af-07fd741b1e7f => generated 1514 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:05:08.274049 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-4a35f88c-6a3a-42b1-983d-0144b072986b tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:05:08.274691 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-4a35f88c-6a3a-42b1-983d-0144b072986b tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 13627154-f64a-4efd-a8af-07fd741b1e7f] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:05:08.282774 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4a35f88c-6a3a-42b1-983d-0144b072986b tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:08.283341 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4a35f88c-6a3a-42b1-983d-0144b072986b tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:08.284193 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4a35f88c-6a3a-42b1-983d-0144b072986b tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:08.284947 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4a35f88c-6a3a-42b1-983d-0144b072986b tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:08.718094 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-4a35f88c-6a3a-42b1-983d-0144b072986b tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:05:08.731887 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-4a35f88c-6a3a-42b1-983d-0144b072986b tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/13627154-f64a-4efd-a8af-07fd741b1e7f" status: 200 len: 1514 microversion: 2.1 time: 0.462239 Apr 15 20:05:08.733996 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 658/1244] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:05:08 2021] GET /compute/v2.1/servers/13627154-f64a-4efd-a8af-07fd741b1e7f => generated 1514 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:05:08.875366 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-54d4bc2d-aa9f-4192-8dc9-7fa5d39e33e7 req-e8ce8f99-b1be-4f4a-9a78-d47da8fec9fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13627154-f64a-4efd-a8af-07fd741b1e7f", "name": "network-vif-deleted", "tag": "bd211326-571f-4b1f-a530-fddff9b0f835"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:05:08.877328 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:05:08.877328 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:05:08.888839 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-54d4bc2d-aa9f-4192-8dc9-7fa5d39e33e7 req-e8ce8f99-b1be-4f4a-9a78-d47da8fec9fa service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:08.889429 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-54d4bc2d-aa9f-4192-8dc9-7fa5d39e33e7 req-e8ce8f99-b1be-4f4a-9a78-d47da8fec9fa service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:08.911620 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-54d4bc2d-aa9f-4192-8dc9-7fa5d39e33e7 req-e8ce8f99-b1be-4f4a-9a78-d47da8fec9fa service nova] Creating event network-vif-deleted:bd211326-571f-4b1f-a530-fddff9b0f835 for instance 13627154-f64a-4efd-a8af-07fd741b1e7f on hv-cinder-78638 Apr 15 20:05:08.918193 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-54d4bc2d-aa9f-4192-8dc9-7fa5d39e33e7 req-e8ce8f99-b1be-4f4a-9a78-d47da8fec9fa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046429 Apr 15 20:05:08.918453 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 587/1245] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:05:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:05:09.750564 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-cc4ef170-c2aa-4916-9bd5-729230c7ee03 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:05:09.751308 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-cc4ef170-c2aa-4916-9bd5-729230c7ee03 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 13627154-f64a-4efd-a8af-07fd741b1e7f] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:05:09.759721 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cc4ef170-c2aa-4916-9bd5-729230c7ee03 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:09.760229 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cc4ef170-c2aa-4916-9bd5-729230c7ee03 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:09.761066 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cc4ef170-c2aa-4916-9bd5-729230c7ee03 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:09.761558 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cc4ef170-c2aa-4916-9bd5-729230c7ee03 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:09.818046 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-cc4ef170-c2aa-4916-9bd5-729230c7ee03 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] HTTP exception thrown: Instance 13627154-f64a-4efd-a8af-07fd741b1e7f could not be found. Apr 15 20:05:09.818711 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-cc4ef170-c2aa-4916-9bd5-729230c7ee03 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Returning 404 to user: Instance 13627154-f64a-4efd-a8af-07fd741b1e7f could not be found. {{(pid=99511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 20:05:09.819688 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-cc4ef170-c2aa-4916-9bd5-729230c7ee03 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/13627154-f64a-4efd-a8af-07fd741b1e7f" status: 404 len: 111 microversion: 2.1 time: 0.073225 Apr 15 20:05:09.820331 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 659/1246] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:05:09 2021] GET /compute/v2.1/servers/13627154-f64a-4efd-a8af-07fd741b1e7f => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 15 20:05:11.073345 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-70519a79-f70a-434e-b42e-e9d2e520a993 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:05:11.073992 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-70519a79-f70a-434e-b42e-e9d2e520a993 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 81a5e60e-1bef-416f-b351-17f3b362a8fa] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:05:11.082621 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-70519a79-f70a-434e-b42e-e9d2e520a993 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:11.083125 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-70519a79-f70a-434e-b42e-e9d2e520a993 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:11.084020 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-70519a79-f70a-434e-b42e-e9d2e520a993 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:11.084511 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-70519a79-f70a-434e-b42e-e9d2e520a993 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:11.154144 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-70519a79-f70a-434e-b42e-e9d2e520a993 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 81a5e60e-1bef-416f-b351-17f3b362a8fa] Going to try to terminate instance {{(pid=99512) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 15 20:05:11.277752 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-70519a79-f70a-434e-b42e-e9d2e520a993 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "DELETE /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa" status: 204 len: 0 microversion: 2.1 time: 0.208914 Apr 15 20:05:11.278327 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 588/1247] 10.222.0.58 () {58 vars in 1229 bytes} [Thu Apr 15 20:05:11 2021] DELETE /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 15 20:05:11.287109 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-dd67c4ac-483a-41ad-841d-8c032ac59112 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:05:11.287912 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-dd67c4ac-483a-41ad-841d-8c032ac59112 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 81a5e60e-1bef-416f-b351-17f3b362a8fa] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:05:11.296241 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dd67c4ac-483a-41ad-841d-8c032ac59112 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:11.296753 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dd67c4ac-483a-41ad-841d-8c032ac59112 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:11.297597 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dd67c4ac-483a-41ad-841d-8c032ac59112 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:11.298097 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dd67c4ac-483a-41ad-841d-8c032ac59112 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:11.767574 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-dd67c4ac-483a-41ad-841d-8c032ac59112 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:05:11.776719 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-dd67c4ac-483a-41ad-841d-8c032ac59112 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa" status: 200 len: 1515 microversion: 2.1 time: 0.493953 Apr 15 20:05:11.777343 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 660/1248] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:05:11 2021] GET /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa => generated 1515 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:05:12.796132 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7467b4ed-b1dc-4c0b-a4de-6dc7c9f0b491 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:05:12.796904 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7467b4ed-b1dc-4c0b-a4de-6dc7c9f0b491 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 81a5e60e-1bef-416f-b351-17f3b362a8fa] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:05:12.805353 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7467b4ed-b1dc-4c0b-a4de-6dc7c9f0b491 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:12.805864 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7467b4ed-b1dc-4c0b-a4de-6dc7c9f0b491 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:12.806705 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7467b4ed-b1dc-4c0b-a4de-6dc7c9f0b491 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:12.807203 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7467b4ed-b1dc-4c0b-a4de-6dc7c9f0b491 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:13.024714 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-7467b4ed-b1dc-4c0b-a4de-6dc7c9f0b491 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:05:13.033940 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7467b4ed-b1dc-4c0b-a4de-6dc7c9f0b491 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa" status: 200 len: 1515 microversion: 2.1 time: 0.242387 Apr 15 20:05:13.034831 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 589/1249] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:05:12 2021] GET /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa => generated 1515 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:05:14.053166 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e78de880-4384-4dc6-8ef6-f894a3840594 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:05:14.054516 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e78de880-4384-4dc6-8ef6-f894a3840594 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 81a5e60e-1bef-416f-b351-17f3b362a8fa] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:05:14.062688 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e78de880-4384-4dc6-8ef6-f894a3840594 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:14.063210 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e78de880-4384-4dc6-8ef6-f894a3840594 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:14.064068 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e78de880-4384-4dc6-8ef6-f894a3840594 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:14.064760 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e78de880-4384-4dc6-8ef6-f894a3840594 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:14.122133 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-a3f735bf-ebb5-45d7-bb18-72e5b89e0b1c req-dcaaed7d-eafe-43a6-814b-ecb9ef1731dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81a5e60e-1bef-416f-b351-17f3b362a8fa", "name": "network-vif-deleted", "tag": "02fef566-85b2-46e5-8c69-a91ebf0f8fe7"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:05:14.123939 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:05:14.123939 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:05:14.134331 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-a3f735bf-ebb5-45d7-bb18-72e5b89e0b1c req-dcaaed7d-eafe-43a6-814b-ecb9ef1731dc service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:14.135328 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-a3f735bf-ebb5-45d7-bb18-72e5b89e0b1c req-dcaaed7d-eafe-43a6-814b-ecb9ef1731dc service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:14.154303 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-a3f735bf-ebb5-45d7-bb18-72e5b89e0b1c req-dcaaed7d-eafe-43a6-814b-ecb9ef1731dc service nova] Creating event network-vif-deleted:02fef566-85b2-46e5-8c69-a91ebf0f8fe7 for instance 81a5e60e-1bef-416f-b351-17f3b362a8fa on hv-cinder-78638 Apr 15 20:05:14.160502 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-a3f735bf-ebb5-45d7-bb18-72e5b89e0b1c req-dcaaed7d-eafe-43a6-814b-ecb9ef1731dc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042166 Apr 15 20:05:14.161341 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 590/1250] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:05:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 15 20:05:14.227961 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-e78de880-4384-4dc6-8ef6-f894a3840594 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:05:14.237275 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e78de880-4384-4dc6-8ef6-f894a3840594 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa" status: 200 len: 1473 microversion: 2.1 time: 0.188164 Apr 15 20:05:14.237903 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 661/1251] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:05:14 2021] GET /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa => generated 1473 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:05:15.256693 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-45f67225-ba87-4278-b4e3-ea0c3cbb5666 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:05:15.257466 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-45f67225-ba87-4278-b4e3-ea0c3cbb5666 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 81a5e60e-1bef-416f-b351-17f3b362a8fa] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:05:15.266260 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-45f67225-ba87-4278-b4e3-ea0c3cbb5666 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:15.266771 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-45f67225-ba87-4278-b4e3-ea0c3cbb5666 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:15.267660 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-45f67225-ba87-4278-b4e3-ea0c3cbb5666 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:15.268157 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-45f67225-ba87-4278-b4e3-ea0c3cbb5666 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:15.325571 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-45f67225-ba87-4278-b4e3-ea0c3cbb5666 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] HTTP exception thrown: Instance 81a5e60e-1bef-416f-b351-17f3b362a8fa could not be found. Apr 15 20:05:15.326240 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-45f67225-ba87-4278-b4e3-ea0c3cbb5666 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Returning 404 to user: Instance 81a5e60e-1bef-416f-b351-17f3b362a8fa could not be found. {{(pid=99512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 20:05:15.327142 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-45f67225-ba87-4278-b4e3-ea0c3cbb5666 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa" status: 404 len: 111 microversion: 2.1 time: 0.075107 Apr 15 20:05:15.327790 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 591/1252] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:05:15 2021] GET /compute/v2.1/servers/81a5e60e-1bef-416f-b351-17f3b362a8fa => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 15 20:05:15.336715 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-151ce093-2b1e-4107-a073-855e018ff99d tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:05:15.337260 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-151ce093-2b1e-4107-a073-855e018ff99d tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 118b1950-dfda-48f8-980a-00ead8b8d208] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:05:15.345336 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-151ce093-2b1e-4107-a073-855e018ff99d tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:15.345847 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-151ce093-2b1e-4107-a073-855e018ff99d tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:15.346686 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-151ce093-2b1e-4107-a073-855e018ff99d tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:15.347172 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-151ce093-2b1e-4107-a073-855e018ff99d tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:15.416259 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-151ce093-2b1e-4107-a073-855e018ff99d tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 118b1950-dfda-48f8-980a-00ead8b8d208] Going to try to terminate instance {{(pid=99511) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 15 20:05:15.532913 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-151ce093-2b1e-4107-a073-855e018ff99d tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "DELETE /compute/v2.1/servers/118b1950-dfda-48f8-980a-00ead8b8d208" status: 204 len: 0 microversion: 2.1 time: 0.200073 Apr 15 20:05:15.533568 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 662/1253] 10.222.0.58 () {58 vars in 1229 bytes} [Thu Apr 15 20:05:15 2021] DELETE /compute/v2.1/servers/118b1950-dfda-48f8-980a-00ead8b8d208 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 15 20:05:15.543158 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-18b5d942-0188-4e04-8c26-8a7cc7faea31 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:05:15.543878 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-18b5d942-0188-4e04-8c26-8a7cc7faea31 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 118b1950-dfda-48f8-980a-00ead8b8d208] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:05:15.552174 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-18b5d942-0188-4e04-8c26-8a7cc7faea31 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:15.552690 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-18b5d942-0188-4e04-8c26-8a7cc7faea31 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:15.553588 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-18b5d942-0188-4e04-8c26-8a7cc7faea31 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:15.554104 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-18b5d942-0188-4e04-8c26-8a7cc7faea31 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:15.774323 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-18b5d942-0188-4e04-8c26-8a7cc7faea31 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:05:15.783239 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-18b5d942-0188-4e04-8c26-8a7cc7faea31 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/118b1950-dfda-48f8-980a-00ead8b8d208" status: 200 len: 1514 microversion: 2.1 time: 0.244796 Apr 15 20:05:15.783827 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 592/1254] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:05:15 2021] GET /compute/v2.1/servers/118b1950-dfda-48f8-980a-00ead8b8d208 => generated 1514 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:05:16.803447 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-27c1ddb9-5b99-4ed8-ac2f-30c60c49223d tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:05:16.804226 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-27c1ddb9-5b99-4ed8-ac2f-30c60c49223d tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 118b1950-dfda-48f8-980a-00ead8b8d208] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:05:16.812429 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-27c1ddb9-5b99-4ed8-ac2f-30c60c49223d tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:16.812941 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-27c1ddb9-5b99-4ed8-ac2f-30c60c49223d tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:16.813780 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-27c1ddb9-5b99-4ed8-ac2f-30c60c49223d tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:16.814275 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-27c1ddb9-5b99-4ed8-ac2f-30c60c49223d tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:17.032204 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-27c1ddb9-5b99-4ed8-ac2f-30c60c49223d tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:05:17.041442 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-27c1ddb9-5b99-4ed8-ac2f-30c60c49223d tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/118b1950-dfda-48f8-980a-00ead8b8d208" status: 200 len: 1514 microversion: 2.1 time: 0.242772 Apr 15 20:05:17.042066 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 663/1255] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:05:16 2021] GET /compute/v2.1/servers/118b1950-dfda-48f8-980a-00ead8b8d208 => generated 1514 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:05:18.041793 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-7df8c4ec-1445-46f0-b049-31372ec64575 req-cf5d5634-b019-458b-b5ea-aa711671b77f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "118b1950-dfda-48f8-980a-00ead8b8d208", "name": "network-vif-deleted", "tag": "0e03daab-9107-44f5-b911-4333acb78689"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:05:18.043781 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:05:18.043781 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:05:18.052696 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-7df8c4ec-1445-46f0-b049-31372ec64575 req-cf5d5634-b019-458b-b5ea-aa711671b77f service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:18.053202 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-7df8c4ec-1445-46f0-b049-31372ec64575 req-cf5d5634-b019-458b-b5ea-aa711671b77f service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:18.060628 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-24eb48ef-5ca7-47bb-8128-8acff901b1d6 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:05:18.061319 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-24eb48ef-5ca7-47bb-8128-8acff901b1d6 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 118b1950-dfda-48f8-980a-00ead8b8d208] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:05:18.069557 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-24eb48ef-5ca7-47bb-8128-8acff901b1d6 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:18.070393 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-24eb48ef-5ca7-47bb-8128-8acff901b1d6 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:18.071153 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-24eb48ef-5ca7-47bb-8128-8acff901b1d6 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:18.071879 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-24eb48ef-5ca7-47bb-8128-8acff901b1d6 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:18.072222 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-7df8c4ec-1445-46f0-b049-31372ec64575 req-cf5d5634-b019-458b-b5ea-aa711671b77f service nova] Creating event network-vif-deleted:0e03daab-9107-44f5-b911-4333acb78689 for instance 118b1950-dfda-48f8-980a-00ead8b8d208 on hv-cinder-78638 Apr 15 20:05:18.078054 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-7df8c4ec-1445-46f0-b049-31372ec64575 req-cf5d5634-b019-458b-b5ea-aa711671b77f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040761 Apr 15 20:05:18.078715 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 593/1256] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:05:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:05:18.217741 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-24eb48ef-5ca7-47bb-8128-8acff901b1d6 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:05:18.227175 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-24eb48ef-5ca7-47bb-8128-8acff901b1d6 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/118b1950-dfda-48f8-980a-00ead8b8d208" status: 200 len: 1303 microversion: 2.1 time: 0.170245 Apr 15 20:05:18.227832 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 664/1257] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:05:18 2021] GET /compute/v2.1/servers/118b1950-dfda-48f8-980a-00ead8b8d208 => generated 1303 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 20:05:19.246541 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-bf9d696b-eca9-41bf-85ad-3910eb867519 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:05:19.247341 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-bf9d696b-eca9-41bf-85ad-3910eb867519 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 118b1950-dfda-48f8-980a-00ead8b8d208] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:05:19.255930 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bf9d696b-eca9-41bf-85ad-3910eb867519 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:19.256439 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bf9d696b-eca9-41bf-85ad-3910eb867519 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:19.257273 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bf9d696b-eca9-41bf-85ad-3910eb867519 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:19.257816 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-bf9d696b-eca9-41bf-85ad-3910eb867519 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:19.311694 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-bf9d696b-eca9-41bf-85ad-3910eb867519 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] HTTP exception thrown: Instance 118b1950-dfda-48f8-980a-00ead8b8d208 could not be found. Apr 15 20:05:19.312364 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-bf9d696b-eca9-41bf-85ad-3910eb867519 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Returning 404 to user: Instance 118b1950-dfda-48f8-980a-00ead8b8d208 could not be found. {{(pid=99512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 20:05:19.313359 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-bf9d696b-eca9-41bf-85ad-3910eb867519 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/118b1950-dfda-48f8-980a-00ead8b8d208" status: 404 len: 111 microversion: 2.1 time: 0.072057 Apr 15 20:05:19.314079 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 594/1258] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:05:19 2021] GET /compute/v2.1/servers/118b1950-dfda-48f8-980a-00ead8b8d208 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 15 20:05:20.570307 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-1ab84c31-2744-4a47-a7aa-849a17166d2e tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:05:20.571174 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-1ab84c31-2744-4a47-a7aa-849a17166d2e tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 318e31f6-3faa-466b-8733-aec0c90a30bd] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:05:20.578581 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1ab84c31-2744-4a47-a7aa-849a17166d2e tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:20.579088 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1ab84c31-2744-4a47-a7aa-849a17166d2e tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:20.579961 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1ab84c31-2744-4a47-a7aa-849a17166d2e tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:20.580454 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1ab84c31-2744-4a47-a7aa-849a17166d2e tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:20.646833 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-1ab84c31-2744-4a47-a7aa-849a17166d2e tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 318e31f6-3faa-466b-8733-aec0c90a30bd] Going to try to terminate instance {{(pid=99511) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 15 20:05:20.768832 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-1ab84c31-2744-4a47-a7aa-849a17166d2e tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "DELETE /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd" status: 204 len: 0 microversion: 2.1 time: 0.202184 Apr 15 20:05:20.769483 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 665/1259] 10.222.0.58 () {58 vars in 1229 bytes} [Thu Apr 15 20:05:20 2021] DELETE /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 15 20:05:20.778620 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-385a7fb7-efcf-4290-b96b-7756b4a4f6bb tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:05:20.779316 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-385a7fb7-efcf-4290-b96b-7756b4a4f6bb tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 318e31f6-3faa-466b-8733-aec0c90a30bd] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:05:20.787372 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-385a7fb7-efcf-4290-b96b-7756b4a4f6bb tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:20.787888 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-385a7fb7-efcf-4290-b96b-7756b4a4f6bb tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:20.788722 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-385a7fb7-efcf-4290-b96b-7756b4a4f6bb tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:20.789220 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-385a7fb7-efcf-4290-b96b-7756b4a4f6bb tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:21.006476 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-385a7fb7-efcf-4290-b96b-7756b4a4f6bb tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:05:21.016047 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-385a7fb7-efcf-4290-b96b-7756b4a4f6bb tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd" status: 200 len: 1515 microversion: 2.1 time: 0.241548 Apr 15 20:05:21.016679 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 595/1260] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:05:20 2021] GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd => generated 1515 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:05:22.035560 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-89dd6fbf-0565-49ce-a2da-64fe0cef07c2 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:05:22.036338 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-89dd6fbf-0565-49ce-a2da-64fe0cef07c2 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 318e31f6-3faa-466b-8733-aec0c90a30bd] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:05:22.044848 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-89dd6fbf-0565-49ce-a2da-64fe0cef07c2 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:22.045352 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-89dd6fbf-0565-49ce-a2da-64fe0cef07c2 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:22.046189 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-89dd6fbf-0565-49ce-a2da-64fe0cef07c2 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:22.046685 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-89dd6fbf-0565-49ce-a2da-64fe0cef07c2 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:22.262936 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-89dd6fbf-0565-49ce-a2da-64fe0cef07c2 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:05:22.273014 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-89dd6fbf-0565-49ce-a2da-64fe0cef07c2 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd" status: 200 len: 1515 microversion: 2.1 time: 0.242344 Apr 15 20:05:22.274298 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 666/1261] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:05:22 2021] GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd => generated 1515 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:05:23.292160 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-11021e8c-1e4c-4204-a12c-c9fd88f8f7a3 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:05:23.292842 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-11021e8c-1e4c-4204-a12c-c9fd88f8f7a3 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 318e31f6-3faa-466b-8733-aec0c90a30bd] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:05:23.301254 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-11021e8c-1e4c-4204-a12c-c9fd88f8f7a3 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:23.301703 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-11021e8c-1e4c-4204-a12c-c9fd88f8f7a3 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:23.302559 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-11021e8c-1e4c-4204-a12c-c9fd88f8f7a3 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:23.303111 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-11021e8c-1e4c-4204-a12c-c9fd88f8f7a3 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:23.518495 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-11021e8c-1e4c-4204-a12c-c9fd88f8f7a3 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd710976383134829a1f71d1a1b5a2a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44df2d570f634a79887bd48d6c2ec9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:05:23.528129 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-11021e8c-1e4c-4204-a12c-c9fd88f8f7a3 tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd" status: 200 len: 1473 microversion: 2.1 time: 0.240024 Apr 15 20:05:23.528784 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 596/1262] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:05:23 2021] GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd => generated 1473 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:05:23.677872 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-0b164fa4-7a58-4119-a0ad-e42034cd8326 req-c8938f31-3480-4f2d-8a38-fafc91e86ded service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "318e31f6-3faa-466b-8733-aec0c90a30bd", "name": "network-vif-deleted", "tag": "70dde193-a63c-4be3-b49a-989926274145"}]} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:05:23.680768 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:05:23.680768 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:05:23.690989 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-0b164fa4-7a58-4119-a0ad-e42034cd8326 req-c8938f31-3480-4f2d-8a38-fafc91e86ded service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:23.691508 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-0b164fa4-7a58-4119-a0ad-e42034cd8326 req-c8938f31-3480-4f2d-8a38-fafc91e86ded service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:23.713469 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-0b164fa4-7a58-4119-a0ad-e42034cd8326 req-c8938f31-3480-4f2d-8a38-fafc91e86ded service nova] Creating event network-vif-deleted:70dde193-a63c-4be3-b49a-989926274145 for instance 318e31f6-3faa-466b-8733-aec0c90a30bd on hv-cinder-78638 Apr 15 20:05:23.718512 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-0b164fa4-7a58-4119-a0ad-e42034cd8326 req-c8938f31-3480-4f2d-8a38-fafc91e86ded service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044613 Apr 15 20:05:23.719193 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 667/1263] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:05:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:05:24.051239 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 15 20:05:24.051538 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: Thu Apr 15 20:05:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 15 20:05:24.547018 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-49a9753c-f13a-445a-bd45-50d07466a17b tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:05:24.547713 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-49a9753c-f13a-445a-bd45-50d07466a17b tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] [instance: 318e31f6-3faa-466b-8733-aec0c90a30bd] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:05:24.555665 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-49a9753c-f13a-445a-bd45-50d07466a17b tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:24.556169 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-49a9753c-f13a-445a-bd45-50d07466a17b tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:24.557003 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-49a9753c-f13a-445a-bd45-50d07466a17b tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:24.557496 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-49a9753c-f13a-445a-bd45-50d07466a17b tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:24.611953 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-49a9753c-f13a-445a-bd45-50d07466a17b tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] HTTP exception thrown: Instance 318e31f6-3faa-466b-8733-aec0c90a30bd could not be found. Apr 15 20:05:24.612621 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-49a9753c-f13a-445a-bd45-50d07466a17b tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] Returning 404 to user: Instance 318e31f6-3faa-466b-8733-aec0c90a30bd could not be found. {{(pid=99512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 20:05:24.613521 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-49a9753c-f13a-445a-bd45-50d07466a17b tempest-AttachVolumeNegativeTest-1555357880 tempest-AttachVolumeNegativeTest-1555357880-project] 10.222.0.58 "GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd" status: 404 len: 111 microversion: 2.1 time: 0.070761 Apr 15 20:05:24.614144 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 597/1264] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:05:24 2021] GET /compute/v2.1/servers/318e31f6-3faa-466b-8733-aec0c90a30bd => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 15 20:05:50.584028 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b31a0404-fc00-4e1e-aaec-7bd0d2d6871f tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-544432247", "imageRef": "10d66d6e-f687-4228-93d1-67502c9b42e2", "flavorRef": "452"}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:05:50.655203 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.network.neutron [None req-b31a0404-fc00-4e1e-aaec-7bd0d2d6871f tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] validate_networks() for None {{(pid=99511) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 15 20:05:50.934019 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-b31a0404-fc00-4e1e-aaec-7bd0d2d6871f tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Flavor limits 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 15 20:05:50.934495 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-b31a0404-fc00-4e1e-aaec-7bd0d2d6871f tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Image limits 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 15 20:05:50.935041 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-b31a0404-fc00-4e1e-aaec-7bd0d2d6871f tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Flavor pref 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 15 20:05:50.935526 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-b31a0404-fc00-4e1e-aaec-7bd0d2d6871f tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Image pref 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 15 20:05:50.935989 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-b31a0404-fc00-4e1e-aaec-7bd0d2d6871f tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 15 20:05:50.945423 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b31a0404-fc00-4e1e-aaec-7bd0d2d6871f tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:50.945875 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b31a0404-fc00-4e1e-aaec-7bd0d2d6871f tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:50.946746 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b31a0404-fc00-4e1e-aaec-7bd0d2d6871f tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:50.947239 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b31a0404-fc00-4e1e-aaec-7bd0d2d6871f tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:50.965827 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-b31a0404-fc00-4e1e-aaec-7bd0d2d6871f tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Getting quotas for project 139054ea7bdb4f99aec6b1b46ca3abb0. Resources: {'cores', 'instances', 'ram'} {{(pid=99511) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 15 20:05:50.970212 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-b31a0404-fc00-4e1e-aaec-7bd0d2d6871f tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Getting quotas for user 335f0bf0ccd245349692af73356f1e4e and project 139054ea7bdb4f99aec6b1b46ca3abb0. Resources: {'cores', 'instances', 'ram'} {{(pid=99511) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 15 20:05:50.981302 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b31a0404-fc00-4e1e-aaec-7bd0d2d6871f tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Going to run 1 instances... {{(pid=99511) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 15 20:05:50.983974 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b31a0404-fc00-4e1e-aaec-7bd0d2d6871f tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] [instance: fec7c601-baf1-4fe4-9a99-896309889899] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='10d66d6e-f687-4228-93d1-67502c9b42e2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 15 20:05:51.034564 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b31a0404-fc00-4e1e-aaec-7bd0d2d6871f tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.455540 Apr 15 20:05:51.035471 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 668/1265] 10.222.0.58 () {60 vars in 1137 bytes} [Thu Apr 15 20:05:50 2021] POST /compute/v2.1/servers => generated 380 bytes in 457 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 15 20:05:51.046334 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-2dd3634f-0afc-4022-a6d9-efdb3f2e4963 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:05:51.047240 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-2dd3634f-0afc-4022-a6d9-efdb3f2e4963 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] [instance: fec7c601-baf1-4fe4-9a99-896309889899] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:05:51.131384 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-2dd3634f-0afc-4022-a6d9-efdb3f2e4963 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335f0bf0ccd245349692af73356f1e4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139054ea7bdb4f99aec6b1b46ca3abb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:05:51.140342 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-2dd3634f-0afc-4022-a6d9-efdb3f2e4963 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] 10.222.0.58 "GET /compute/v2.1/servers/fec7c601-baf1-4fe4-9a99-896309889899" status: 200 len: 1214 microversion: 2.1 time: 0.098176 Apr 15 20:05:51.141262 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 598/1266] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:05:51 2021] GET /compute/v2.1/servers/fec7c601-baf1-4fe4-9a99-896309889899 => generated 1214 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:05:52.158670 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-65ca80b4-747e-41d8-8a01-7deeaeeaab19 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:05:52.160401 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-65ca80b4-747e-41d8-8a01-7deeaeeaab19 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] [instance: fec7c601-baf1-4fe4-9a99-896309889899] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:05:52.169433 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-65ca80b4-747e-41d8-8a01-7deeaeeaab19 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:52.170236 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-65ca80b4-747e-41d8-8a01-7deeaeeaab19 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:52.171157 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-65ca80b4-747e-41d8-8a01-7deeaeeaab19 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:52.171679 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-65ca80b4-747e-41d8-8a01-7deeaeeaab19 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:52.365343 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-65ca80b4-747e-41d8-8a01-7deeaeeaab19 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335f0bf0ccd245349692af73356f1e4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139054ea7bdb4f99aec6b1b46ca3abb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:05:52.373912 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-65ca80b4-747e-41d8-8a01-7deeaeeaab19 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] 10.222.0.58 "GET /compute/v2.1/servers/fec7c601-baf1-4fe4-9a99-896309889899" status: 200 len: 1274 microversion: 2.1 time: 0.219436 Apr 15 20:05:52.374576 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 669/1267] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:05:52 2021] GET /compute/v2.1/servers/fec7c601-baf1-4fe4-9a99-896309889899 => generated 1274 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:05:53.393303 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-91ac289b-001b-4091-bd3d-7c3ef1ecacd2 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:05:53.393969 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-91ac289b-001b-4091-bd3d-7c3ef1ecacd2 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] [instance: fec7c601-baf1-4fe4-9a99-896309889899] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:05:53.403445 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-91ac289b-001b-4091-bd3d-7c3ef1ecacd2 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:53.403956 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-91ac289b-001b-4091-bd3d-7c3ef1ecacd2 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:53.404850 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-91ac289b-001b-4091-bd3d-7c3ef1ecacd2 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:53.405344 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-91ac289b-001b-4091-bd3d-7c3ef1ecacd2 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:54.149335 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-91ac289b-001b-4091-bd3d-7c3ef1ecacd2 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335f0bf0ccd245349692af73356f1e4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139054ea7bdb4f99aec6b1b46ca3abb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:05:54.158414 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-91ac289b-001b-4091-bd3d-7c3ef1ecacd2 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] 10.222.0.58 "GET /compute/v2.1/servers/fec7c601-baf1-4fe4-9a99-896309889899" status: 200 len: 1314 microversion: 2.1 time: 0.769684 Apr 15 20:05:54.159397 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 599/1268] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:05:53 2021] GET /compute/v2.1/servers/fec7c601-baf1-4fe4-9a99-896309889899 => generated 1314 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 15 20:05:54.994843 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-3cea327b-d4ab-42bc-9bab-89f0d05b4a49 req-7a4d0912-6320-457b-aa79-c720241bdde7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fec7c601-baf1-4fe4-9a99-896309889899", "tag": "f1317b80-bea3-4a9f-90bf-e37eaf268e3d"}]} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:05:54.996830 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:05:54.996830 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:05:55.006645 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-3cea327b-d4ab-42bc-9bab-89f0d05b4a49 req-7a4d0912-6320-457b-aa79-c720241bdde7 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:55.007561 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-3cea327b-d4ab-42bc-9bab-89f0d05b4a49 req-7a4d0912-6320-457b-aa79-c720241bdde7 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:55.026359 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-3cea327b-d4ab-42bc-9bab-89f0d05b4a49 req-7a4d0912-6320-457b-aa79-c720241bdde7 service nova] Creating event network-changed:f1317b80-bea3-4a9f-90bf-e37eaf268e3d for instance fec7c601-baf1-4fe4-9a99-896309889899 on hv-cinder-78638 Apr 15 20:05:55.031483 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-3cea327b-d4ab-42bc-9bab-89f0d05b4a49 req-7a4d0912-6320-457b-aa79-c720241bdde7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045621 Apr 15 20:05:55.032182 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 670/1269] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:05:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:05:55.177000 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-1e1162c6-2d14-4b94-89df-c26cb909e4a3 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:05:55.177677 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-1e1162c6-2d14-4b94-89df-c26cb909e4a3 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] [instance: fec7c601-baf1-4fe4-9a99-896309889899] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:05:55.185690 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1e1162c6-2d14-4b94-89df-c26cb909e4a3 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:55.186204 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1e1162c6-2d14-4b94-89df-c26cb909e4a3 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:55.187046 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1e1162c6-2d14-4b94-89df-c26cb909e4a3 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:55.187571 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1e1162c6-2d14-4b94-89df-c26cb909e4a3 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:55.553292 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-1e1162c6-2d14-4b94-89df-c26cb909e4a3 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335f0bf0ccd245349692af73356f1e4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139054ea7bdb4f99aec6b1b46ca3abb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:05:55.562739 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-1e1162c6-2d14-4b94-89df-c26cb909e4a3 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] 10.222.0.58 "GET /compute/v2.1/servers/fec7c601-baf1-4fe4-9a99-896309889899" status: 200 len: 1314 microversion: 2.1 time: 0.389753 Apr 15 20:05:55.563392 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 600/1270] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:05:55 2021] GET /compute/v2.1/servers/fec7c601-baf1-4fe4-9a99-896309889899 => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:05:56.581450 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-2fd2a7ce-08ea-47b8-af03-7175e38582be tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:05:56.582219 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-2fd2a7ce-08ea-47b8-af03-7175e38582be tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] [instance: fec7c601-baf1-4fe4-9a99-896309889899] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:05:56.590869 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2fd2a7ce-08ea-47b8-af03-7175e38582be tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:56.591440 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2fd2a7ce-08ea-47b8-af03-7175e38582be tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:56.592269 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2fd2a7ce-08ea-47b8-af03-7175e38582be tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:56.592765 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2fd2a7ce-08ea-47b8-af03-7175e38582be tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:56.805339 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-2fd2a7ce-08ea-47b8-af03-7175e38582be tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335f0bf0ccd245349692af73356f1e4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139054ea7bdb4f99aec6b1b46ca3abb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:05:56.814247 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-2fd2a7ce-08ea-47b8-af03-7175e38582be tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] 10.222.0.58 "GET /compute/v2.1/servers/fec7c601-baf1-4fe4-9a99-896309889899" status: 200 len: 1314 microversion: 2.1 time: 0.237358 Apr 15 20:05:56.814869 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 671/1271] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:05:56 2021] GET /compute/v2.1/servers/fec7c601-baf1-4fe4-9a99-896309889899 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:05:57.832740 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-1f2ac96e-b9a6-46f1-99a1-0a7b109333cf tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:05:57.833408 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-1f2ac96e-b9a6-46f1-99a1-0a7b109333cf tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] [instance: fec7c601-baf1-4fe4-9a99-896309889899] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:05:57.841783 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1f2ac96e-b9a6-46f1-99a1-0a7b109333cf tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:57.842289 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1f2ac96e-b9a6-46f1-99a1-0a7b109333cf tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:57.843134 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1f2ac96e-b9a6-46f1-99a1-0a7b109333cf tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:57.843681 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1f2ac96e-b9a6-46f1-99a1-0a7b109333cf tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:58.057895 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-1f2ac96e-b9a6-46f1-99a1-0a7b109333cf tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335f0bf0ccd245349692af73356f1e4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139054ea7bdb4f99aec6b1b46ca3abb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:05:58.066756 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-1f2ac96e-b9a6-46f1-99a1-0a7b109333cf tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] 10.222.0.58 "GET /compute/v2.1/servers/fec7c601-baf1-4fe4-9a99-896309889899" status: 200 len: 1314 microversion: 2.1 time: 0.238055 Apr 15 20:05:58.067395 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 601/1272] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:05:57 2021] GET /compute/v2.1/servers/fec7c601-baf1-4fe4-9a99-896309889899 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:05:59.085422 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-c8fc4d28-d9a1-416a-b9e3-ac976b6d93cd tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:05:59.086195 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-c8fc4d28-d9a1-416a-b9e3-ac976b6d93cd tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] [instance: fec7c601-baf1-4fe4-9a99-896309889899] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:05:59.094223 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c8fc4d28-d9a1-416a-b9e3-ac976b6d93cd tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:59.094740 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c8fc4d28-d9a1-416a-b9e3-ac976b6d93cd tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:59.095652 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c8fc4d28-d9a1-416a-b9e3-ac976b6d93cd tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:05:59.096156 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-c8fc4d28-d9a1-416a-b9e3-ac976b6d93cd tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:05:59.315116 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-c8fc4d28-d9a1-416a-b9e3-ac976b6d93cd tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335f0bf0ccd245349692af73356f1e4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139054ea7bdb4f99aec6b1b46ca3abb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:05:59.324178 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-c8fc4d28-d9a1-416a-b9e3-ac976b6d93cd tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] 10.222.0.58 "GET /compute/v2.1/servers/fec7c601-baf1-4fe4-9a99-896309889899" status: 200 len: 1314 microversion: 2.1 time: 0.243352 Apr 15 20:05:59.324808 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 672/1273] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:05:59 2021] GET /compute/v2.1/servers/fec7c601-baf1-4fe4-9a99-896309889899 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:06:00.342037 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-df9f1e9c-81d0-440d-8601-0544437318ee tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:06:00.342753 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-df9f1e9c-81d0-440d-8601-0544437318ee tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] [instance: fec7c601-baf1-4fe4-9a99-896309889899] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:06:00.350601 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-df9f1e9c-81d0-440d-8601-0544437318ee tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:00.351628 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-df9f1e9c-81d0-440d-8601-0544437318ee tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:00.352454 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-df9f1e9c-81d0-440d-8601-0544437318ee tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:00.352947 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-df9f1e9c-81d0-440d-8601-0544437318ee tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:00.569266 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-df9f1e9c-81d0-440d-8601-0544437318ee tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335f0bf0ccd245349692af73356f1e4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139054ea7bdb4f99aec6b1b46ca3abb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:06:00.578147 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-df9f1e9c-81d0-440d-8601-0544437318ee tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] 10.222.0.58 "GET /compute/v2.1/servers/fec7c601-baf1-4fe4-9a99-896309889899" status: 200 len: 1314 microversion: 2.1 time: 0.240128 Apr 15 20:06:00.578764 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 602/1274] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:06:00 2021] GET /compute/v2.1/servers/fec7c601-baf1-4fe4-9a99-896309889899 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:06:01.284702 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-4f79dae8-a982-4fcb-856c-40b6b89cd582 req-008b5c79-d472-4636-a94d-20d94558e07c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fec7c601-baf1-4fe4-9a99-896309889899", "name": "network-vif-plugged", "status": "completed", "tag": "f1317b80-bea3-4a9f-90bf-e37eaf268e3d"}]} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:06:01.286723 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:06:01.286723 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:06:01.297714 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-4f79dae8-a982-4fcb-856c-40b6b89cd582 req-008b5c79-d472-4636-a94d-20d94558e07c service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:01.298220 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-4f79dae8-a982-4fcb-856c-40b6b89cd582 req-008b5c79-d472-4636-a94d-20d94558e07c service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:01.316835 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-4f79dae8-a982-4fcb-856c-40b6b89cd582 req-008b5c79-d472-4636-a94d-20d94558e07c service nova] Creating event network-vif-plugged:f1317b80-bea3-4a9f-90bf-e37eaf268e3d for instance fec7c601-baf1-4fe4-9a99-896309889899 on hv-cinder-78638 Apr 15 20:06:01.322102 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-4f79dae8-a982-4fcb-856c-40b6b89cd582 req-008b5c79-d472-4636-a94d-20d94558e07c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041681 Apr 15 20:06:01.322762 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 673/1275] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:06:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:06:01.596197 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-1d8648f4-8f79-47b3-9069-062f6bb6edae tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:06:01.596871 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-1d8648f4-8f79-47b3-9069-062f6bb6edae tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] [instance: fec7c601-baf1-4fe4-9a99-896309889899] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:06:01.605413 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1d8648f4-8f79-47b3-9069-062f6bb6edae tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:01.605931 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1d8648f4-8f79-47b3-9069-062f6bb6edae tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:01.606771 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1d8648f4-8f79-47b3-9069-062f6bb6edae tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:01.607265 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1d8648f4-8f79-47b3-9069-062f6bb6edae tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:01.816704 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-1d8648f4-8f79-47b3-9069-062f6bb6edae tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335f0bf0ccd245349692af73356f1e4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139054ea7bdb4f99aec6b1b46ca3abb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:06:01.825487 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-1d8648f4-8f79-47b3-9069-062f6bb6edae tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] 10.222.0.58 "GET /compute/v2.1/servers/fec7c601-baf1-4fe4-9a99-896309889899" status: 200 len: 1314 microversion: 2.1 time: 0.233389 Apr 15 20:06:01.826107 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 603/1276] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:06:01 2021] GET /compute/v2.1/servers/fec7c601-baf1-4fe4-9a99-896309889899 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:06:02.845097 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-8079e990-862b-4e56-9943-e8c1d3ec7f0f tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:06:02.845878 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-8079e990-862b-4e56-9943-e8c1d3ec7f0f tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] [instance: fec7c601-baf1-4fe4-9a99-896309889899] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:06:02.854186 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8079e990-862b-4e56-9943-e8c1d3ec7f0f tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:02.854703 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8079e990-862b-4e56-9943-e8c1d3ec7f0f tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:02.855580 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8079e990-862b-4e56-9943-e8c1d3ec7f0f tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:02.856083 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8079e990-862b-4e56-9943-e8c1d3ec7f0f tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:03.075262 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-8079e990-862b-4e56-9943-e8c1d3ec7f0f tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335f0bf0ccd245349692af73356f1e4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139054ea7bdb4f99aec6b1b46ca3abb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:06:03.084822 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-8079e990-862b-4e56-9943-e8c1d3ec7f0f tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] 10.222.0.58 "GET /compute/v2.1/servers/fec7c601-baf1-4fe4-9a99-896309889899" status: 200 len: 1464 microversion: 2.1 time: 0.244257 Apr 15 20:06:03.085438 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 674/1277] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:06:02 2021] GET /compute/v2.1/servers/fec7c601-baf1-4fe4-9a99-896309889899 => generated 1464 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:06:03.159200 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-dca8afed-9044-4a5c-ad2a-617c5d8bf83b tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:06:03.159853 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-dca8afed-9044-4a5c-ad2a-617c5d8bf83b tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] [instance: fec7c601-baf1-4fe4-9a99-896309889899] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:06:03.167803 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dca8afed-9044-4a5c-ad2a-617c5d8bf83b tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:03.168937 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dca8afed-9044-4a5c-ad2a-617c5d8bf83b tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:03.169778 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dca8afed-9044-4a5c-ad2a-617c5d8bf83b tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:03.170452 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-dca8afed-9044-4a5c-ad2a-617c5d8bf83b tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:03.238398 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-dca8afed-9044-4a5c-ad2a-617c5d8bf83b tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] [instance: fec7c601-baf1-4fe4-9a99-896309889899] Going to try to terminate instance {{(pid=99512) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 15 20:06:03.355135 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-dca8afed-9044-4a5c-ad2a-617c5d8bf83b tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] 10.222.0.58 "DELETE /compute/v2.1/servers/fec7c601-baf1-4fe4-9a99-896309889899" status: 204 len: 0 microversion: 2.1 time: 0.200040 Apr 15 20:06:03.356276 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 604/1278] 10.222.0.58 () {58 vars in 1229 bytes} [Thu Apr 15 20:06:03 2021] DELETE /compute/v2.1/servers/fec7c601-baf1-4fe4-9a99-896309889899 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 15 20:06:03.364801 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-0ce75606-10ba-4be2-bd8c-509cf44318e0 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:06:03.365477 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-0ce75606-10ba-4be2-bd8c-509cf44318e0 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] [instance: fec7c601-baf1-4fe4-9a99-896309889899] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:06:03.373937 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0ce75606-10ba-4be2-bd8c-509cf44318e0 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:03.374459 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0ce75606-10ba-4be2-bd8c-509cf44318e0 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:03.375291 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0ce75606-10ba-4be2-bd8c-509cf44318e0 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:03.375794 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0ce75606-10ba-4be2-bd8c-509cf44318e0 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:03.589325 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-0ce75606-10ba-4be2-bd8c-509cf44318e0 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335f0bf0ccd245349692af73356f1e4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139054ea7bdb4f99aec6b1b46ca3abb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:06:03.601978 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-0ce75606-10ba-4be2-bd8c-509cf44318e0 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] 10.222.0.58 "GET /compute/v2.1/servers/fec7c601-baf1-4fe4-9a99-896309889899" status: 200 len: 1470 microversion: 2.1 time: 0.241175 Apr 15 20:06:03.602600 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 675/1279] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:06:03 2021] GET /compute/v2.1/servers/fec7c601-baf1-4fe4-9a99-896309889899 => generated 1470 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:06:04.621269 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-507e798e-5364-4986-bb1e-d9b053f5b56c tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:06:04.622032 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-507e798e-5364-4986-bb1e-d9b053f5b56c tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] [instance: fec7c601-baf1-4fe4-9a99-896309889899] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:06:04.629932 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-507e798e-5364-4986-bb1e-d9b053f5b56c tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:04.630435 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-507e798e-5364-4986-bb1e-d9b053f5b56c tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:04.631262 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-507e798e-5364-4986-bb1e-d9b053f5b56c tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:04.631771 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-507e798e-5364-4986-bb1e-d9b053f5b56c tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:04.851809 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-507e798e-5364-4986-bb1e-d9b053f5b56c tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335f0bf0ccd245349692af73356f1e4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139054ea7bdb4f99aec6b1b46ca3abb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:06:04.860671 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-507e798e-5364-4986-bb1e-d9b053f5b56c tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] 10.222.0.58 "GET /compute/v2.1/servers/fec7c601-baf1-4fe4-9a99-896309889899" status: 200 len: 1470 microversion: 2.1 time: 0.244050 Apr 15 20:06:04.861295 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 605/1280] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:06:04 2021] GET /compute/v2.1/servers/fec7c601-baf1-4fe4-9a99-896309889899 => generated 1470 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:06:05.879362 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-41478437-c63f-4ce2-b0a6-0a4b36835051 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:06:05.879973 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-41478437-c63f-4ce2-b0a6-0a4b36835051 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] [instance: fec7c601-baf1-4fe4-9a99-896309889899] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:06:05.888205 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-41478437-c63f-4ce2-b0a6-0a4b36835051 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:05.888719 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-41478437-c63f-4ce2-b0a6-0a4b36835051 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:05.889585 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-41478437-c63f-4ce2-b0a6-0a4b36835051 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:05.890086 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-41478437-c63f-4ce2-b0a6-0a4b36835051 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:06.024331 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-41478437-c63f-4ce2-b0a6-0a4b36835051 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335f0bf0ccd245349692af73356f1e4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '139054ea7bdb4f99aec6b1b46ca3abb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:06:06.035964 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-41478437-c63f-4ce2-b0a6-0a4b36835051 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] 10.222.0.58 "GET /compute/v2.1/servers/fec7c601-baf1-4fe4-9a99-896309889899" status: 200 len: 1428 microversion: 2.1 time: 0.160696 Apr 15 20:06:06.036972 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 676/1281] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:06:05 2021] GET /compute/v2.1/servers/fec7c601-baf1-4fe4-9a99-896309889899 => generated 1428 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:06:06.144871 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-049f61ef-87e9-42c9-af61-2560a2d59033 req-7bb688fc-7e20-41f1-803e-ebf6b61bdafb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fec7c601-baf1-4fe4-9a99-896309889899", "name": "network-vif-deleted", "tag": "f1317b80-bea3-4a9f-90bf-e37eaf268e3d"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:06:06.146983 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:06:06.146983 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:06:06.158886 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-049f61ef-87e9-42c9-af61-2560a2d59033 req-7bb688fc-7e20-41f1-803e-ebf6b61bdafb service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:06.159403 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-049f61ef-87e9-42c9-af61-2560a2d59033 req-7bb688fc-7e20-41f1-803e-ebf6b61bdafb service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:06.182538 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-049f61ef-87e9-42c9-af61-2560a2d59033 req-7bb688fc-7e20-41f1-803e-ebf6b61bdafb service nova] Creating event network-vif-deleted:f1317b80-bea3-4a9f-90bf-e37eaf268e3d for instance fec7c601-baf1-4fe4-9a99-896309889899 on hv-cinder-78638 Apr 15 20:06:06.188901 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-049f61ef-87e9-42c9-af61-2560a2d59033 req-7bb688fc-7e20-41f1-803e-ebf6b61bdafb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047964 Apr 15 20:06:06.189564 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 606/1282] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:06:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:06:07.055504 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-da26949f-ef0e-4b4f-bba4-cbf47ac0af81 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:06:07.056181 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-da26949f-ef0e-4b4f-bba4-cbf47ac0af81 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] [instance: fec7c601-baf1-4fe4-9a99-896309889899] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:06:07.064199 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-da26949f-ef0e-4b4f-bba4-cbf47ac0af81 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:07.064707 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-da26949f-ef0e-4b4f-bba4-cbf47ac0af81 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:07.065552 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-da26949f-ef0e-4b4f-bba4-cbf47ac0af81 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:07.066047 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-da26949f-ef0e-4b4f-bba4-cbf47ac0af81 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:07.120783 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-da26949f-ef0e-4b4f-bba4-cbf47ac0af81 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] HTTP exception thrown: Instance fec7c601-baf1-4fe4-9a99-896309889899 could not be found. Apr 15 20:06:07.121459 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-da26949f-ef0e-4b4f-bba4-cbf47ac0af81 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] Returning 404 to user: Instance fec7c601-baf1-4fe4-9a99-896309889899 could not be found. {{(pid=99511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 20:06:07.122369 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-da26949f-ef0e-4b4f-bba4-cbf47ac0af81 tempest-VolumesNegativeTest-2068036238 tempest-VolumesNegativeTest-2068036238-project] 10.222.0.58 "GET /compute/v2.1/servers/fec7c601-baf1-4fe4-9a99-896309889899" status: 404 len: 111 microversion: 2.1 time: 0.071465 Apr 15 20:06:07.122984 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 677/1283] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:06:07 2021] GET /compute/v2.1/servers/fec7c601-baf1-4fe4-9a99-896309889899 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 15 20:06:18.995373 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-ca9edd19-f0cd-4502-b664-be96a5c9d70e tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:06:18.995974 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ca9edd19-f0cd-4502-b664-be96a5c9d70e tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: ee7a266a-70f6-4c26-b5e4-3c7c99a196b1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:06:19.004004 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ca9edd19-f0cd-4502-b664-be96a5c9d70e tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:19.004519 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ca9edd19-f0cd-4502-b664-be96a5c9d70e tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:19.005341 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ca9edd19-f0cd-4502-b664-be96a5c9d70e tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:19.005830 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-ca9edd19-f0cd-4502-b664-be96a5c9d70e tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:19.070102 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-ca9edd19-f0cd-4502-b664-be96a5c9d70e tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: ee7a266a-70f6-4c26-b5e4-3c7c99a196b1] Going to try to terminate instance {{(pid=99512) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 15 20:06:19.182650 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-ca9edd19-f0cd-4502-b664-be96a5c9d70e tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1" status: 204 len: 0 microversion: 2.1 time: 0.192707 Apr 15 20:06:19.183306 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 607/1284] 10.222.0.58 () {58 vars in 1229 bytes} [Thu Apr 15 20:06:18 2021] DELETE /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 15 20:06:19.192041 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-34af49a3-4b92-47f9-b345-95942e30b0a1 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:06:19.192718 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-34af49a3-4b92-47f9-b345-95942e30b0a1 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: ee7a266a-70f6-4c26-b5e4-3c7c99a196b1] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:06:19.200530 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-34af49a3-4b92-47f9-b345-95942e30b0a1 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:19.201035 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-34af49a3-4b92-47f9-b345-95942e30b0a1 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:19.201858 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-34af49a3-4b92-47f9-b345-95942e30b0a1 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:19.202347 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-34af49a3-4b92-47f9-b345-95942e30b0a1 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:19.411423 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-34af49a3-4b92-47f9-b345-95942e30b0a1 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:06:19.420780 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-34af49a3-4b92-47f9-b345-95942e30b0a1 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1" status: 200 len: 1575 microversion: 2.1 time: 0.232894 Apr 15 20:06:19.421390 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 678/1285] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:06:19 2021] GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1 => generated 1575 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:06:20.440983 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f8603441-a596-4930-895d-b82679250851 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:06:20.441761 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f8603441-a596-4930-895d-b82679250851 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: ee7a266a-70f6-4c26-b5e4-3c7c99a196b1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:06:20.450279 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f8603441-a596-4930-895d-b82679250851 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:20.450805 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f8603441-a596-4930-895d-b82679250851 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:20.451697 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f8603441-a596-4930-895d-b82679250851 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:20.452200 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f8603441-a596-4930-895d-b82679250851 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:20.669573 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f8603441-a596-4930-895d-b82679250851 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:06:20.678697 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f8603441-a596-4930-895d-b82679250851 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1" status: 200 len: 1575 microversion: 2.1 time: 0.242318 Apr 15 20:06:20.679335 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 608/1286] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:06:20 2021] GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1 => generated 1575 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:06:21.697846 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-0cf2b70b-798f-4794-a9db-c8fce4738663 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:06:21.698559 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-0cf2b70b-798f-4794-a9db-c8fce4738663 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: ee7a266a-70f6-4c26-b5e4-3c7c99a196b1] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:06:21.706957 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0cf2b70b-798f-4794-a9db-c8fce4738663 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:21.707781 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0cf2b70b-798f-4794-a9db-c8fce4738663 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:21.708644 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0cf2b70b-798f-4794-a9db-c8fce4738663 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:21.709143 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0cf2b70b-798f-4794-a9db-c8fce4738663 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:21.884993 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-0cf2b70b-798f-4794-a9db-c8fce4738663 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:06:21.894024 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-0cf2b70b-798f-4794-a9db-c8fce4738663 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1" status: 200 len: 1508 microversion: 2.1 time: 0.200306 Apr 15 20:06:21.894649 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 679/1287] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:06:21 2021] GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1 => generated 1508 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:06:22.414381 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-cec869af-683f-43df-9fc7-325cb7ef1589 req-6b943bf8-10e4-4326-8d5d-db52cf2fa635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee7a266a-70f6-4c26-b5e4-3c7c99a196b1", "name": "network-vif-deleted", "tag": "d19ac357-560f-4e16-8746-937ee97d7e5c"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:06:22.416306 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:06:22.416306 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:06:22.426882 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-cec869af-683f-43df-9fc7-325cb7ef1589 req-6b943bf8-10e4-4326-8d5d-db52cf2fa635 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:22.428026 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-cec869af-683f-43df-9fc7-325cb7ef1589 req-6b943bf8-10e4-4326-8d5d-db52cf2fa635 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:22.458035 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-cec869af-683f-43df-9fc7-325cb7ef1589 req-6b943bf8-10e4-4326-8d5d-db52cf2fa635 service nova] Creating event network-vif-deleted:d19ac357-560f-4e16-8746-937ee97d7e5c for instance ee7a266a-70f6-4c26-b5e4-3c7c99a196b1 on hv-cinder-78638 Apr 15 20:06:22.463652 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-cec869af-683f-43df-9fc7-325cb7ef1589 req-6b943bf8-10e4-4326-8d5d-db52cf2fa635 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054088 Apr 15 20:06:22.464483 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 609/1288] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:06:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:06:22.912432 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-cc33081c-e208-47d4-9dfa-39a99886270d tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:06:22.913228 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-cc33081c-e208-47d4-9dfa-39a99886270d tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: ee7a266a-70f6-4c26-b5e4-3c7c99a196b1] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:06:22.922595 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cc33081c-e208-47d4-9dfa-39a99886270d tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:22.923192 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cc33081c-e208-47d4-9dfa-39a99886270d tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:22.924135 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cc33081c-e208-47d4-9dfa-39a99886270d tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:22.924708 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cc33081c-e208-47d4-9dfa-39a99886270d tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:22.997648 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cc33081c-e208-47d4-9dfa-39a99886270d tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:22.998077 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-cc33081c-e208-47d4-9dfa-39a99886270d tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:22.998587 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.objects.instance [None req-cc33081c-e208-47d4-9dfa-39a99886270d tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lazy-loading 'fault' on Instance uuid ee7a266a-70f6-4c26-b5e4-3c7c99a196b1 {{(pid=99511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 15 20:06:23.078928 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-cc33081c-e208-47d4-9dfa-39a99886270d tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:06:23.089921 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-cc33081c-e208-47d4-9dfa-39a99886270d tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1" status: 200 len: 1228 microversion: 2.1 time: 0.181900 Apr 15 20:06:23.090535 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 680/1289] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:06:22 2021] GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1 => generated 1228 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:06:24.109355 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b954080c-15a6-4cd0-ad33-876294be4646 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:06:24.110120 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b954080c-15a6-4cd0-ad33-876294be4646 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: ee7a266a-70f6-4c26-b5e4-3c7c99a196b1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:06:24.118371 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b954080c-15a6-4cd0-ad33-876294be4646 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:24.118880 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b954080c-15a6-4cd0-ad33-876294be4646 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:24.119748 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b954080c-15a6-4cd0-ad33-876294be4646 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:24.120246 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b954080c-15a6-4cd0-ad33-876294be4646 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:24.173910 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-b954080c-15a6-4cd0-ad33-876294be4646 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] HTTP exception thrown: Instance ee7a266a-70f6-4c26-b5e4-3c7c99a196b1 could not be found. Apr 15 20:06:24.174577 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b954080c-15a6-4cd0-ad33-876294be4646 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Returning 404 to user: Instance ee7a266a-70f6-4c26-b5e4-3c7c99a196b1 could not be found. {{(pid=99512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 20:06:24.175508 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b954080c-15a6-4cd0-ad33-876294be4646 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1" status: 404 len: 111 microversion: 2.1 time: 0.070735 Apr 15 20:06:24.176117 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 610/1290] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:06:24 2021] GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 15 20:06:24.289086 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-aa671e38-87af-4624-b439-f08cef32fc6c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-683863203", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-934650097", "security_groups": [{"name": "tempest-secgroup-smoke-743425793"}], "block_device_mapping_v2": [{"uuid": "e73c2760-4c80-424a-baee-5b5c98e3bbb7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5a40994e-48a3-4ca3-b74f-8d7720ae07a5"}]}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:06:24.457783 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.network.neutron [None req-aa671e38-87af-4624-b439-f08cef32fc6c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] validate_networks() for [('5a40994e-48a3-4ca3-b74f-8d7720ae07a5', None, None, None)] {{(pid=99511) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 15 20:06:25.015629 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-aa671e38-87af-4624-b439-f08cef32fc6c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Flavor limits 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 15 20:06:25.016117 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-aa671e38-87af-4624-b439-f08cef32fc6c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Image limits 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 15 20:06:25.016669 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-aa671e38-87af-4624-b439-f08cef32fc6c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Flavor pref 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 15 20:06:25.017136 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-aa671e38-87af-4624-b439-f08cef32fc6c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Image pref 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 15 20:06:25.017644 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-aa671e38-87af-4624-b439-f08cef32fc6c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 15 20:06:25.027048 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-aa671e38-87af-4624-b439-f08cef32fc6c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:25.027590 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-aa671e38-87af-4624-b439-f08cef32fc6c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:25.028486 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-aa671e38-87af-4624-b439-f08cef32fc6c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:25.028988 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-aa671e38-87af-4624-b439-f08cef32fc6c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:25.048290 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-aa671e38-87af-4624-b439-f08cef32fc6c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Getting quotas for project 3e2a79620ac740e5a6e598a862a97631. Resources: {'cores', 'instances', 'ram'} {{(pid=99511) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 15 20:06:25.052590 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-aa671e38-87af-4624-b439-f08cef32fc6c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Getting quotas for user 5c9d86e8f847470c8403807462b1f8cb and project 3e2a79620ac740e5a6e598a862a97631. Resources: {'cores', 'instances', 'ram'} {{(pid=99511) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 15 20:06:25.163946 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-aa671e38-87af-4624-b439-f08cef32fc6c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Going to run 1 instances... {{(pid=99511) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 15 20:06:25.166487 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-aa671e38-87af-4624-b439-f08cef32fc6c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 6f9e6ef9-1db2-4595-8248-ad9b8e016a14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e73c2760-4c80-424a-baee-5b5c98e3bbb7',volume_size=None,volume_type=None)] {{(pid=99511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 15 20:06:25.465780 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-aa671e38-87af-4624-b439-f08cef32fc6c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.180704 Apr 15 20:06:25.466474 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 681/1291] 10.222.0.58 () {60 vars in 1137 bytes} [Thu Apr 15 20:06:24 2021] POST /compute/v2.1/servers => generated 405 bytes in 1182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 15 20:06:25.477114 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-0f70f1f4-0e52-44f8-9fa0-6e796b2498ac tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:06:25.477946 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-0f70f1f4-0e52-44f8-9fa0-6e796b2498ac tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 6f9e6ef9-1db2-4595-8248-ad9b8e016a14] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:06:25.558648 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-0f70f1f4-0e52-44f8-9fa0-6e796b2498ac tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:06:25.567099 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-0f70f1f4-0e52-44f8-9fa0-6e796b2498ac tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/6f9e6ef9-1db2-4595-8248-ad9b8e016a14" status: 200 len: 1093 microversion: 2.1 time: 0.093963 Apr 15 20:06:25.567853 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 611/1292] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:06:25 2021] GET /compute/v2.1/servers/6f9e6ef9-1db2-4595-8248-ad9b8e016a14 => generated 1093 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:06:26.585334 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e7bef7a9-0e5b-43f6-853b-6d55433e4c2b tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:06:26.586058 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e7bef7a9-0e5b-43f6-853b-6d55433e4c2b tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 6f9e6ef9-1db2-4595-8248-ad9b8e016a14] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:06:26.595016 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e7bef7a9-0e5b-43f6-853b-6d55433e4c2b tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:26.595572 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e7bef7a9-0e5b-43f6-853b-6d55433e4c2b tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:26.596428 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e7bef7a9-0e5b-43f6-853b-6d55433e4c2b tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:26.596935 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e7bef7a9-0e5b-43f6-853b-6d55433e4c2b tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:27.035158 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-e7bef7a9-0e5b-43f6-853b-6d55433e4c2b tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:06:27.045142 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e7bef7a9-0e5b-43f6-853b-6d55433e4c2b tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/6f9e6ef9-1db2-4595-8248-ad9b8e016a14" status: 200 len: 1209 microversion: 2.1 time: 0.463755 Apr 15 20:06:27.046145 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 682/1293] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:06:26 2021] GET /compute/v2.1/servers/6f9e6ef9-1db2-4595-8248-ad9b8e016a14 => generated 1209 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:06:28.063496 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d280d134-6dc9-49ac-9661-0006ee449da7 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:06:28.064146 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d280d134-6dc9-49ac-9661-0006ee449da7 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 6f9e6ef9-1db2-4595-8248-ad9b8e016a14] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:06:28.077533 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d280d134-6dc9-49ac-9661-0006ee449da7 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:28.078013 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d280d134-6dc9-49ac-9661-0006ee449da7 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:28.078900 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d280d134-6dc9-49ac-9661-0006ee449da7 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:28.079418 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d280d134-6dc9-49ac-9661-0006ee449da7 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:28.524675 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d280d134-6dc9-49ac-9661-0006ee449da7 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:06:28.534934 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d280d134-6dc9-49ac-9661-0006ee449da7 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/6f9e6ef9-1db2-4595-8248-ad9b8e016a14" status: 200 len: 1264 microversion: 2.1 time: 0.475356 Apr 15 20:06:28.535676 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 612/1294] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:06:28 2021] GET /compute/v2.1/servers/6f9e6ef9-1db2-4595-8248-ad9b8e016a14 => generated 1264 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:06:29.289910 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-d6640e46-661c-4403-a874-c6cc63777f12 req-7a239b9d-9512-4ac7-b10c-045eef38510d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f9e6ef9-1db2-4595-8248-ad9b8e016a14", "tag": "b64308a7-eb62-4b2e-9892-8ef7175a60d5"}]} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:06:29.291932 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:06:29.291932 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:06:29.302336 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-d6640e46-661c-4403-a874-c6cc63777f12 req-7a239b9d-9512-4ac7-b10c-045eef38510d service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:29.302894 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-d6640e46-661c-4403-a874-c6cc63777f12 req-7a239b9d-9512-4ac7-b10c-045eef38510d service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:29.321938 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-d6640e46-661c-4403-a874-c6cc63777f12 req-7a239b9d-9512-4ac7-b10c-045eef38510d service nova] Creating event network-changed:b64308a7-eb62-4b2e-9892-8ef7175a60d5 for instance 6f9e6ef9-1db2-4595-8248-ad9b8e016a14 on hv-cinder-78638 Apr 15 20:06:29.327459 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-d6640e46-661c-4403-a874-c6cc63777f12 req-7a239b9d-9512-4ac7-b10c-045eef38510d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042298 Apr 15 20:06:29.328409 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 683/1295] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:06:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:06:29.555784 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-059b577e-35c2-4042-9826-9f26da3e2c4e tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:06:29.556439 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-059b577e-35c2-4042-9826-9f26da3e2c4e tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 6f9e6ef9-1db2-4595-8248-ad9b8e016a14] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:06:29.564787 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-059b577e-35c2-4042-9826-9f26da3e2c4e tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:29.565329 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-059b577e-35c2-4042-9826-9f26da3e2c4e tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:29.566205 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-059b577e-35c2-4042-9826-9f26da3e2c4e tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:29.566743 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-059b577e-35c2-4042-9826-9f26da3e2c4e tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:29.987023 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-059b577e-35c2-4042-9826-9f26da3e2c4e tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:06:29.996232 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-059b577e-35c2-4042-9826-9f26da3e2c4e tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/6f9e6ef9-1db2-4595-8248-ad9b8e016a14" status: 200 len: 1264 microversion: 2.1 time: 0.444965 Apr 15 20:06:29.996853 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 613/1296] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:06:29 2021] GET /compute/v2.1/servers/6f9e6ef9-1db2-4595-8248-ad9b8e016a14 => generated 1264 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:06:31.015389 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-08f1c64c-86ed-48b2-ac4b-e77ae683b550 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:06:31.016078 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-08f1c64c-86ed-48b2-ac4b-e77ae683b550 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 6f9e6ef9-1db2-4595-8248-ad9b8e016a14] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:06:31.024901 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-08f1c64c-86ed-48b2-ac4b-e77ae683b550 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:31.025417 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-08f1c64c-86ed-48b2-ac4b-e77ae683b550 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:31.026264 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-08f1c64c-86ed-48b2-ac4b-e77ae683b550 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:31.026808 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-08f1c64c-86ed-48b2-ac4b-e77ae683b550 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:31.242923 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-08f1c64c-86ed-48b2-ac4b-e77ae683b550 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:06:31.251817 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-08f1c64c-86ed-48b2-ac4b-e77ae683b550 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/6f9e6ef9-1db2-4595-8248-ad9b8e016a14" status: 200 len: 1264 microversion: 2.1 time: 0.241321 Apr 15 20:06:31.252435 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 684/1297] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:06:31 2021] GET /compute/v2.1/servers/6f9e6ef9-1db2-4595-8248-ad9b8e016a14 => generated 1264 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:06:32.270324 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9732475f-57eb-43f0-9cc6-1f34898c8289 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:06:32.271002 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-9732475f-57eb-43f0-9cc6-1f34898c8289 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 6f9e6ef9-1db2-4595-8248-ad9b8e016a14] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:06:32.279491 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9732475f-57eb-43f0-9cc6-1f34898c8289 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:32.279998 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9732475f-57eb-43f0-9cc6-1f34898c8289 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:32.280825 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9732475f-57eb-43f0-9cc6-1f34898c8289 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:32.281325 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-9732475f-57eb-43f0-9cc6-1f34898c8289 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:32.492489 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-9732475f-57eb-43f0-9cc6-1f34898c8289 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:06:32.501435 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9732475f-57eb-43f0-9cc6-1f34898c8289 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/6f9e6ef9-1db2-4595-8248-ad9b8e016a14" status: 200 len: 1264 microversion: 2.1 time: 0.235180 Apr 15 20:06:32.502051 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 614/1298] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:06:32 2021] GET /compute/v2.1/servers/6f9e6ef9-1db2-4595-8248-ad9b8e016a14 => generated 1264 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:06:33.519473 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6f1c947e-9424-41b8-87f3-6daa09334160 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:06:33.520149 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6f1c947e-9424-41b8-87f3-6daa09334160 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 6f9e6ef9-1db2-4595-8248-ad9b8e016a14] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:06:33.528352 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6f1c947e-9424-41b8-87f3-6daa09334160 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:33.528860 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6f1c947e-9424-41b8-87f3-6daa09334160 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:33.529672 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6f1c947e-9424-41b8-87f3-6daa09334160 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:33.530167 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6f1c947e-9424-41b8-87f3-6daa09334160 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:33.745707 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-6f1c947e-9424-41b8-87f3-6daa09334160 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:06:33.754651 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6f1c947e-9424-41b8-87f3-6daa09334160 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/6f9e6ef9-1db2-4595-8248-ad9b8e016a14" status: 200 len: 1264 microversion: 2.1 time: 0.239305 Apr 15 20:06:33.755307 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 685/1299] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:06:33 2021] GET /compute/v2.1/servers/6f9e6ef9-1db2-4595-8248-ad9b8e016a14 => generated 1264 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:06:34.772873 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-3c4823d3-2918-47ab-888b-0437d6dba854 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:06:34.773490 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-3c4823d3-2918-47ab-888b-0437d6dba854 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 6f9e6ef9-1db2-4595-8248-ad9b8e016a14] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:06:34.781388 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3c4823d3-2918-47ab-888b-0437d6dba854 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:34.781901 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3c4823d3-2918-47ab-888b-0437d6dba854 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:34.782732 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3c4823d3-2918-47ab-888b-0437d6dba854 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:34.783492 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-3c4823d3-2918-47ab-888b-0437d6dba854 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:35.002415 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-3c4823d3-2918-47ab-888b-0437d6dba854 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:06:35.011801 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-3c4823d3-2918-47ab-888b-0437d6dba854 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/6f9e6ef9-1db2-4595-8248-ad9b8e016a14" status: 200 len: 1264 microversion: 2.1 time: 0.242982 Apr 15 20:06:35.012416 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 615/1300] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:06:34 2021] GET /compute/v2.1/servers/6f9e6ef9-1db2-4595-8248-ad9b8e016a14 => generated 1264 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:06:36.030075 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-2e182cb9-8d06-4f38-a527-2362b00d3cf7 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:06:36.030682 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-2e182cb9-8d06-4f38-a527-2362b00d3cf7 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 6f9e6ef9-1db2-4595-8248-ad9b8e016a14] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:06:36.038809 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2e182cb9-8d06-4f38-a527-2362b00d3cf7 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:36.039347 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2e182cb9-8d06-4f38-a527-2362b00d3cf7 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:36.040190 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2e182cb9-8d06-4f38-a527-2362b00d3cf7 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:36.040679 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2e182cb9-8d06-4f38-a527-2362b00d3cf7 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:36.259463 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-2e182cb9-8d06-4f38-a527-2362b00d3cf7 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:06:36.268505 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-2e182cb9-8d06-4f38-a527-2362b00d3cf7 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/6f9e6ef9-1db2-4595-8248-ad9b8e016a14" status: 200 len: 1264 microversion: 2.1 time: 0.242603 Apr 15 20:06:36.269117 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 686/1301] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:06:36 2021] GET /compute/v2.1/servers/6f9e6ef9-1db2-4595-8248-ad9b8e016a14 => generated 1264 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:06:37.287470 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6c449612-81f4-4f9f-8d0e-99b3825167cd tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:06:37.288200 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6c449612-81f4-4f9f-8d0e-99b3825167cd tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 6f9e6ef9-1db2-4595-8248-ad9b8e016a14] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:06:37.296114 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6c449612-81f4-4f9f-8d0e-99b3825167cd tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:37.296618 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6c449612-81f4-4f9f-8d0e-99b3825167cd tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:37.297456 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6c449612-81f4-4f9f-8d0e-99b3825167cd tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:37.297940 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6c449612-81f4-4f9f-8d0e-99b3825167cd tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:37.522634 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-6c449612-81f4-4f9f-8d0e-99b3825167cd tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:06:37.532334 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6c449612-81f4-4f9f-8d0e-99b3825167cd tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/6f9e6ef9-1db2-4595-8248-ad9b8e016a14" status: 200 len: 1264 microversion: 2.1 time: 0.249271 Apr 15 20:06:37.532949 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 616/1302] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:06:37 2021] GET /compute/v2.1/servers/6f9e6ef9-1db2-4595-8248-ad9b8e016a14 => generated 1264 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:06:38.551579 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-08b609c4-0266-408f-ac04-745be5802d74 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:06:38.552255 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-08b609c4-0266-408f-ac04-745be5802d74 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 6f9e6ef9-1db2-4595-8248-ad9b8e016a14] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:06:38.560274 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-08b609c4-0266-408f-ac04-745be5802d74 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:38.560787 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-08b609c4-0266-408f-ac04-745be5802d74 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:38.561617 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-08b609c4-0266-408f-ac04-745be5802d74 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:38.562112 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-08b609c4-0266-408f-ac04-745be5802d74 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:38.774862 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-08b609c4-0266-408f-ac04-745be5802d74 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:06:38.784287 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-08b609c4-0266-408f-ac04-745be5802d74 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/6f9e6ef9-1db2-4595-8248-ad9b8e016a14" status: 200 len: 1264 microversion: 2.1 time: 0.236701 Apr 15 20:06:38.784919 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 687/1303] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:06:38 2021] GET /compute/v2.1/servers/6f9e6ef9-1db2-4595-8248-ad9b8e016a14 => generated 1264 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:06:39.578804 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-7d17b474-dddc-4150-86cb-b577d3604bbc req-aa762941-080f-437d-9dc1-fd6fb7a85fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f9e6ef9-1db2-4595-8248-ad9b8e016a14", "name": "network-vif-plugged", "status": "completed", "tag": "b64308a7-eb62-4b2e-9892-8ef7175a60d5"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:06:39.580688 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:06:39.580688 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:06:39.590364 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-7d17b474-dddc-4150-86cb-b577d3604bbc req-aa762941-080f-437d-9dc1-fd6fb7a85fb5 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:39.590855 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-7d17b474-dddc-4150-86cb-b577d3604bbc req-aa762941-080f-437d-9dc1-fd6fb7a85fb5 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:39.608532 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-7d17b474-dddc-4150-86cb-b577d3604bbc req-aa762941-080f-437d-9dc1-fd6fb7a85fb5 service nova] Creating event network-vif-plugged:b64308a7-eb62-4b2e-9892-8ef7175a60d5 for instance 6f9e6ef9-1db2-4595-8248-ad9b8e016a14 on hv-cinder-78638 Apr 15 20:06:39.613720 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-7d17b474-dddc-4150-86cb-b577d3604bbc req-aa762941-080f-437d-9dc1-fd6fb7a85fb5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039270 Apr 15 20:06:39.614364 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 617/1304] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:06:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:06:39.802630 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-349ee252-ee55-476e-8ac3-9ba9788aace2 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:06:39.803385 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-349ee252-ee55-476e-8ac3-9ba9788aace2 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 6f9e6ef9-1db2-4595-8248-ad9b8e016a14] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:06:39.811321 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-349ee252-ee55-476e-8ac3-9ba9788aace2 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:39.811826 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-349ee252-ee55-476e-8ac3-9ba9788aace2 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:39.812664 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-349ee252-ee55-476e-8ac3-9ba9788aace2 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:39.813159 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-349ee252-ee55-476e-8ac3-9ba9788aace2 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:40.066611 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-349ee252-ee55-476e-8ac3-9ba9788aace2 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:06:40.076011 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-349ee252-ee55-476e-8ac3-9ba9788aace2 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/6f9e6ef9-1db2-4595-8248-ad9b8e016a14" status: 200 len: 1264 microversion: 2.1 time: 0.277729 Apr 15 20:06:40.076636 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 688/1305] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:06:39 2021] GET /compute/v2.1/servers/6f9e6ef9-1db2-4595-8248-ad9b8e016a14 => generated 1264 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:06:41.094715 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-318d0716-089f-4866-baa5-a7ab255c69ef tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:06:41.095531 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-318d0716-089f-4866-baa5-a7ab255c69ef tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 6f9e6ef9-1db2-4595-8248-ad9b8e016a14] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:06:41.104118 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-318d0716-089f-4866-baa5-a7ab255c69ef tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:41.104631 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-318d0716-089f-4866-baa5-a7ab255c69ef tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:41.105496 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-318d0716-089f-4866-baa5-a7ab255c69ef tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:41.105992 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-318d0716-089f-4866-baa5-a7ab255c69ef tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:41.630597 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-318d0716-089f-4866-baa5-a7ab255c69ef tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:06:41.639561 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-318d0716-089f-4866-baa5-a7ab255c69ef tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/6f9e6ef9-1db2-4595-8248-ad9b8e016a14" status: 200 len: 1452 microversion: 2.1 time: 0.549360 Apr 15 20:06:41.640157 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 618/1306] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:06:41 2021] GET /compute/v2.1/servers/6f9e6ef9-1db2-4595-8248-ad9b8e016a14 => generated 1452 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:06:41.656632 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a86d19e7-2343-4036-bf0e-7e49c355c675 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:06:41.657302 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a86d19e7-2343-4036-bf0e-7e49c355c675 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 6f9e6ef9-1db2-4595-8248-ad9b8e016a14] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:06:41.665800 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a86d19e7-2343-4036-bf0e-7e49c355c675 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:41.666299 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a86d19e7-2343-4036-bf0e-7e49c355c675 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:41.667128 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a86d19e7-2343-4036-bf0e-7e49c355c675 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:41.667679 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a86d19e7-2343-4036-bf0e-7e49c355c675 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:41.880026 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a86d19e7-2343-4036-bf0e-7e49c355c675 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:06:41.888910 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a86d19e7-2343-4036-bf0e-7e49c355c675 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/6f9e6ef9-1db2-4595-8248-ad9b8e016a14" status: 200 len: 1452 microversion: 2.1 time: 0.236238 Apr 15 20:06:41.889530 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 689/1307] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:06:41 2021] GET /compute/v2.1/servers/6f9e6ef9-1db2-4595-8248-ad9b8e016a14 => generated 1452 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:06:44.775747 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-c81aa2d6-e049-4e19-8f0e-a740b7bd5334 req-1e122550-07c8-4217-abdc-889e6f472c34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f9e6ef9-1db2-4595-8248-ad9b8e016a14", "tag": "b64308a7-eb62-4b2e-9892-8ef7175a60d5"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:06:44.776243 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:06:44.776243 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:06:44.785720 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-c81aa2d6-e049-4e19-8f0e-a740b7bd5334 req-1e122550-07c8-4217-abdc-889e6f472c34 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:06:44.786223 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-c81aa2d6-e049-4e19-8f0e-a740b7bd5334 req-1e122550-07c8-4217-abdc-889e6f472c34 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:06:44.805635 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-c81aa2d6-e049-4e19-8f0e-a740b7bd5334 req-1e122550-07c8-4217-abdc-889e6f472c34 service nova] Creating event network-changed:b64308a7-eb62-4b2e-9892-8ef7175a60d5 for instance 6f9e6ef9-1db2-4595-8248-ad9b8e016a14 on hv-cinder-78638 Apr 15 20:06:44.810946 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-c81aa2d6-e049-4e19-8f0e-a740b7bd5334 req-1e122550-07c8-4217-abdc-889e6f472c34 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040499 Apr 15 20:06:44.811665 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 619/1308] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:06:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 15 20:07:12.065484 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 15 20:07:12.065996 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: Thu Apr 15 20:07:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 15 20:08:44.068692 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 15 20:08:44.069362 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: Thu Apr 15 20:08:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 15 20:08:49.617904 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-88f435b8-95ae-47ae-ab9b-969a016527c7 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1716638177", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-934650097", "security_groups": [{"name": "tempest-secgroup-smoke-743425793"}], "block_device_mapping_v2": [{"uuid": "218030a7-6b26-4bef-9521-e4a4f59fd91e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5a40994e-48a3-4ca3-b74f-8d7720ae07a5"}]}} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:08:49.632074 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: ERROR oslo.messaging._drivers.impl_rabbit [-] [32990d9b-7b19-4241-8690-db01fbba9bdf] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 15 20:08:49.841520 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.network.neutron [None req-88f435b8-95ae-47ae-ab9b-969a016527c7 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] validate_networks() for [('5a40994e-48a3-4ca3-b74f-8d7720ae07a5', None, None, None)] {{(pid=99511) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 15 20:08:50.495031 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-88f435b8-95ae-47ae-ab9b-969a016527c7 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Flavor limits 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 15 20:08:50.495628 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-88f435b8-95ae-47ae-ab9b-969a016527c7 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Image limits 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 15 20:08:50.496218 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-88f435b8-95ae-47ae-ab9b-969a016527c7 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Flavor pref 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 15 20:08:50.497219 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-88f435b8-95ae-47ae-ab9b-969a016527c7 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Image pref 0:0:0 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 15 20:08:50.497728 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.virt.hardware [None req-88f435b8-95ae-47ae-ab9b-969a016527c7 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 15 20:08:50.506724 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-88f435b8-95ae-47ae-ab9b-969a016527c7 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:08:50.507240 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-88f435b8-95ae-47ae-ab9b-969a016527c7 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:08:50.508181 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-88f435b8-95ae-47ae-ab9b-969a016527c7 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:08:50.508676 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-88f435b8-95ae-47ae-ab9b-969a016527c7 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:08:50.527756 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-88f435b8-95ae-47ae-ab9b-969a016527c7 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Getting quotas for project 3e2a79620ac740e5a6e598a862a97631. Resources: {'cores', 'instances', 'ram'} {{(pid=99511) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 15 20:08:50.532259 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.quota [None req-88f435b8-95ae-47ae-ab9b-969a016527c7 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Getting quotas for user 5c9d86e8f847470c8403807462b1f8cb and project 3e2a79620ac740e5a6e598a862a97631. Resources: {'cores', 'instances', 'ram'} {{(pid=99511) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 15 20:08:50.647003 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-88f435b8-95ae-47ae-ab9b-969a016527c7 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Going to run 1 instances... {{(pid=99511) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 15 20:08:50.649451 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-88f435b8-95ae-47ae-ab9b-969a016527c7 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 17b722fa-9e4a-48dd-88f8-93d1f656e655] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='218030a7-6b26-4bef-9521-e4a4f59fd91e',volume_size=None,volume_type=None)] {{(pid=99511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 15 20:08:50.657659 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO oslo.messaging._drivers.impl_rabbit [-] [32990d9b-7b19-4241-8690-db01fbba9bdf] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 58456. Apr 15 20:08:50.832641 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-88f435b8-95ae-47ae-ab9b-969a016527c7 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.218782 Apr 15 20:08:50.833343 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 690/1309] 10.222.0.58 () {60 vars in 1137 bytes} [Thu Apr 15 20:08:49 2021] POST /compute/v2.1/servers => generated 405 bytes in 1220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 15 20:08:50.846011 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-2608b985-fc42-462c-a514-1cebe259730c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:08:50.846907 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-2608b985-fc42-462c-a514-1cebe259730c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 17b722fa-9e4a-48dd-88f8-93d1f656e655] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:08:50.938218 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-2608b985-fc42-462c-a514-1cebe259730c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:08:50.946267 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-2608b985-fc42-462c-a514-1cebe259730c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655" status: 200 len: 1094 microversion: 2.1 time: 0.106000 Apr 15 20:08:50.947124 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 620/1310] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:08:50 2021] GET /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655 => generated 1094 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:08:51.965951 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-643d9af8-828b-4b30-913d-f6a512c3c9c1 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:08:51.966669 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-643d9af8-828b-4b30-913d-f6a512c3c9c1 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 17b722fa-9e4a-48dd-88f8-93d1f656e655] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:08:51.974771 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-643d9af8-828b-4b30-913d-f6a512c3c9c1 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:08:51.975289 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-643d9af8-828b-4b30-913d-f6a512c3c9c1 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:08:51.976177 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-643d9af8-828b-4b30-913d-f6a512c3c9c1 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:08:51.976676 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-643d9af8-828b-4b30-913d-f6a512c3c9c1 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:08:52.180333 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-643d9af8-828b-4b30-913d-f6a512c3c9c1 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:08:52.189651 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-643d9af8-828b-4b30-913d-f6a512c3c9c1 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655" status: 200 len: 1200 microversion: 2.1 time: 0.228478 Apr 15 20:08:52.190480 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 691/1311] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:08:51 2021] GET /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655 => generated 1200 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:08:53.209138 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-8c333783-9517-408f-93a6-73a5662fa1d8 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:08:53.210081 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-8c333783-9517-408f-93a6-73a5662fa1d8 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 17b722fa-9e4a-48dd-88f8-93d1f656e655] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:08:53.220352 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8c333783-9517-408f-93a6-73a5662fa1d8 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:08:53.220908 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8c333783-9517-408f-93a6-73a5662fa1d8 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:08:53.221854 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8c333783-9517-408f-93a6-73a5662fa1d8 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:08:53.222377 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-8c333783-9517-408f-93a6-73a5662fa1d8 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:08:53.712483 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-8c333783-9517-408f-93a6-73a5662fa1d8 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:08:53.725984 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-8c333783-9517-408f-93a6-73a5662fa1d8 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655" status: 200 len: 1265 microversion: 2.1 time: 0.520972 Apr 15 20:08:53.726863 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 621/1312] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:08:53 2021] GET /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655 => generated 1265 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:08:54.744779 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d7bcf29c-cd7a-4b1f-8cfa-5b6cbb3fff96 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:08:54.745464 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d7bcf29c-cd7a-4b1f-8cfa-5b6cbb3fff96 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 17b722fa-9e4a-48dd-88f8-93d1f656e655] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:08:54.754169 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d7bcf29c-cd7a-4b1f-8cfa-5b6cbb3fff96 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:08:54.754769 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d7bcf29c-cd7a-4b1f-8cfa-5b6cbb3fff96 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:08:54.755655 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d7bcf29c-cd7a-4b1f-8cfa-5b6cbb3fff96 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:08:54.756160 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d7bcf29c-cd7a-4b1f-8cfa-5b6cbb3fff96 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:08:55.062660 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-56f307db-e08e-4f04-934d-c20426522734 req-52443f99-9608-4b5b-a8da-842d9359f5b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17b722fa-9e4a-48dd-88f8-93d1f656e655", "tag": "5358e72c-15a2-43ec-b22a-4dd2c6f3c647"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:08:55.064650 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:08:55.064650 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:08:55.074469 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-56f307db-e08e-4f04-934d-c20426522734 req-52443f99-9608-4b5b-a8da-842d9359f5b2 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:08:55.075449 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-56f307db-e08e-4f04-934d-c20426522734 req-52443f99-9608-4b5b-a8da-842d9359f5b2 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:08:55.095908 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-56f307db-e08e-4f04-934d-c20426522734 req-52443f99-9608-4b5b-a8da-842d9359f5b2 service nova] Creating event network-changed:5358e72c-15a2-43ec-b22a-4dd2c6f3c647 for instance 17b722fa-9e4a-48dd-88f8-93d1f656e655 on hv-cinder-78638 Apr 15 20:08:55.101534 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-56f307db-e08e-4f04-934d-c20426522734 req-52443f99-9608-4b5b-a8da-842d9359f5b2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115548 Apr 15 20:08:55.103015 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 622/1313] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:08:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:08:55.118078 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-d7bcf29c-cd7a-4b1f-8cfa-5b6cbb3fff96 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:08:55.128391 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d7bcf29c-cd7a-4b1f-8cfa-5b6cbb3fff96 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655" status: 200 len: 1265 microversion: 2.1 time: 0.387567 Apr 15 20:08:55.129181 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 692/1314] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:08:54 2021] GET /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655 => generated 1265 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:08:56.150900 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-148d73d0-5d99-44d2-bebd-4243ba5e5018 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:08:56.151718 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-148d73d0-5d99-44d2-bebd-4243ba5e5018 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 17b722fa-9e4a-48dd-88f8-93d1f656e655] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:08:56.160060 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-148d73d0-5d99-44d2-bebd-4243ba5e5018 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:08:56.160561 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-148d73d0-5d99-44d2-bebd-4243ba5e5018 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:08:56.161393 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-148d73d0-5d99-44d2-bebd-4243ba5e5018 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:08:56.161883 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-148d73d0-5d99-44d2-bebd-4243ba5e5018 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:08:56.561139 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-148d73d0-5d99-44d2-bebd-4243ba5e5018 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:08:56.571070 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-148d73d0-5d99-44d2-bebd-4243ba5e5018 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655" status: 200 len: 1265 microversion: 2.1 time: 0.424644 Apr 15 20:08:56.571978 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 623/1315] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:08:56 2021] GET /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655 => generated 1265 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:08:57.590447 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-0a845fee-aa4d-45a9-a402-4adde6ce6222 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:08:57.591124 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-0a845fee-aa4d-45a9-a402-4adde6ce6222 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 17b722fa-9e4a-48dd-88f8-93d1f656e655] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:08:57.599072 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0a845fee-aa4d-45a9-a402-4adde6ce6222 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:08:57.599616 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0a845fee-aa4d-45a9-a402-4adde6ce6222 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:08:57.600454 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0a845fee-aa4d-45a9-a402-4adde6ce6222 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:08:57.600991 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-0a845fee-aa4d-45a9-a402-4adde6ce6222 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:08:57.813174 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-0a845fee-aa4d-45a9-a402-4adde6ce6222 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:08:57.822088 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-0a845fee-aa4d-45a9-a402-4adde6ce6222 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655" status: 200 len: 1265 microversion: 2.1 time: 0.235982 Apr 15 20:08:57.822703 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 693/1316] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:08:57 2021] GET /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655 => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:08:58.842041 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-29ebd7c2-bd5f-43b0-9a6d-1e04bfd56723 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:08:58.842638 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-29ebd7c2-bd5f-43b0-9a6d-1e04bfd56723 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 17b722fa-9e4a-48dd-88f8-93d1f656e655] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:08:58.850432 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-29ebd7c2-bd5f-43b0-9a6d-1e04bfd56723 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:08:58.850941 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-29ebd7c2-bd5f-43b0-9a6d-1e04bfd56723 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:08:58.851799 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-29ebd7c2-bd5f-43b0-9a6d-1e04bfd56723 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:08:58.852288 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-29ebd7c2-bd5f-43b0-9a6d-1e04bfd56723 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:08:59.066996 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-29ebd7c2-bd5f-43b0-9a6d-1e04bfd56723 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:08:59.075839 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-29ebd7c2-bd5f-43b0-9a6d-1e04bfd56723 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655" status: 200 len: 1265 microversion: 2.1 time: 0.239682 Apr 15 20:08:59.076453 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 624/1317] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:08:58 2021] GET /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655 => generated 1265 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:09:00.094621 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a0182700-d1f7-41a0-a9ce-f81ac840b43a tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:09:00.095369 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a0182700-d1f7-41a0-a9ce-f81ac840b43a tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 17b722fa-9e4a-48dd-88f8-93d1f656e655] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:09:00.103368 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a0182700-d1f7-41a0-a9ce-f81ac840b43a tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:09:00.103888 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a0182700-d1f7-41a0-a9ce-f81ac840b43a tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:09:00.104729 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a0182700-d1f7-41a0-a9ce-f81ac840b43a tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:09:00.105226 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a0182700-d1f7-41a0-a9ce-f81ac840b43a tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:09:00.314979 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a0182700-d1f7-41a0-a9ce-f81ac840b43a tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:09:00.323939 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a0182700-d1f7-41a0-a9ce-f81ac840b43a tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655" status: 200 len: 1265 microversion: 2.1 time: 0.234285 Apr 15 20:09:00.325174 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 694/1318] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:09:00 2021] GET /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655 => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:09:00.921114 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 15 20:09:00.921114 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: Thu Apr 15 20:09:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 15 20:09:01.342936 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-7e90bbe6-69f5-456d-a1e0-16fff24fe204 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:09:01.343639 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-7e90bbe6-69f5-456d-a1e0-16fff24fe204 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 17b722fa-9e4a-48dd-88f8-93d1f656e655] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:09:01.351551 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7e90bbe6-69f5-456d-a1e0-16fff24fe204 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:09:01.352068 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7e90bbe6-69f5-456d-a1e0-16fff24fe204 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:09:01.352904 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7e90bbe6-69f5-456d-a1e0-16fff24fe204 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:09:01.353395 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-7e90bbe6-69f5-456d-a1e0-16fff24fe204 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:09:01.568453 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-7e90bbe6-69f5-456d-a1e0-16fff24fe204 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:09:01.577856 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-7e90bbe6-69f5-456d-a1e0-16fff24fe204 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655" status: 200 len: 1265 microversion: 2.1 time: 0.239528 Apr 15 20:09:01.578466 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 625/1319] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:09:01 2021] GET /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655 => generated 1265 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:09:02.596960 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-85b11dac-2624-48a5-9e64-3279b537ad3a tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:09:02.597637 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-85b11dac-2624-48a5-9e64-3279b537ad3a tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 17b722fa-9e4a-48dd-88f8-93d1f656e655] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:09:02.605559 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-85b11dac-2624-48a5-9e64-3279b537ad3a tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:09:02.606106 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-85b11dac-2624-48a5-9e64-3279b537ad3a tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:09:02.606945 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-85b11dac-2624-48a5-9e64-3279b537ad3a tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:09:02.607473 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-85b11dac-2624-48a5-9e64-3279b537ad3a tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:09:02.850739 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-85b11dac-2624-48a5-9e64-3279b537ad3a tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:09:02.860108 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-85b11dac-2624-48a5-9e64-3279b537ad3a tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655" status: 200 len: 1265 microversion: 2.1 time: 0.267527 Apr 15 20:09:02.860717 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 695/1320] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:09:02 2021] GET /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655 => generated 1265 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:09:03.878988 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-4ab040ef-97ed-4d35-96d9-4f5ee661b2ee tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:09:03.879726 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-4ab040ef-97ed-4d35-96d9-4f5ee661b2ee tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 17b722fa-9e4a-48dd-88f8-93d1f656e655] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:09:03.883094 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fd4b25ba-2b20-4c32-83f1-e1fabfeca321] AMQP server on 10.222.0.58:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 15 20:09:03.888518 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4ab040ef-97ed-4d35-96d9-4f5ee661b2ee tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:09:03.889027 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4ab040ef-97ed-4d35-96d9-4f5ee661b2ee tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:09:03.889875 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4ab040ef-97ed-4d35-96d9-4f5ee661b2ee tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:09:03.890371 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-4ab040ef-97ed-4d35-96d9-4f5ee661b2ee tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:09:04.145070 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-4ab040ef-97ed-4d35-96d9-4f5ee661b2ee tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:09:04.155035 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-4ab040ef-97ed-4d35-96d9-4f5ee661b2ee tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655" status: 200 len: 1265 microversion: 2.1 time: 0.280181 Apr 15 20:09:04.155783 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 626/1321] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:09:03 2021] GET /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655 => generated 1265 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:09:05.175098 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f09171a1-eb64-4392-9b43-77582b4c972b tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:09:05.175891 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f09171a1-eb64-4392-9b43-77582b4c972b tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 17b722fa-9e4a-48dd-88f8-93d1f656e655] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:09:05.185141 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f09171a1-eb64-4392-9b43-77582b4c972b tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:09:05.185654 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f09171a1-eb64-4392-9b43-77582b4c972b tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:09:05.186557 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f09171a1-eb64-4392-9b43-77582b4c972b tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:09:05.187052 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f09171a1-eb64-4392-9b43-77582b4c972b tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:09:05.405263 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f09171a1-eb64-4392-9b43-77582b4c972b tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:09:05.414757 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f09171a1-eb64-4392-9b43-77582b4c972b tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655" status: 200 len: 1265 microversion: 2.1 time: 0.245178 Apr 15 20:09:05.415407 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 696/1322] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:09:05 2021] GET /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655 => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:09:06.097210 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO oslo.messaging._drivers.impl_rabbit [-] [fd4b25ba-2b20-4c32-83f1-e1fabfeca321] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 58508. Apr 15 20:09:06.144583 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-55034e55-40a3-4295-b609-3542d3e526d3 req-78be5f65-5f34-42f6-ab0d-165c8e41744b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17b722fa-9e4a-48dd-88f8-93d1f656e655", "name": "network-vif-plugged", "status": "completed", "tag": "5358e72c-15a2-43ec-b22a-4dd2c6f3c647"}]} {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:09:06.146325 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:09:06.146325 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:09:06.156874 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-55034e55-40a3-4295-b609-3542d3e526d3 req-78be5f65-5f34-42f6-ab0d-165c8e41744b service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:09:06.157382 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-55034e55-40a3-4295-b609-3542d3e526d3 req-78be5f65-5f34-42f6-ab0d-165c8e41744b service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:09:06.177673 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-55034e55-40a3-4295-b609-3542d3e526d3 req-78be5f65-5f34-42f6-ab0d-165c8e41744b service nova] Creating event network-vif-plugged:5358e72c-15a2-43ec-b22a-4dd2c6f3c647 for instance 17b722fa-9e4a-48dd-88f8-93d1f656e655 on hv-cinder-78638 Apr 15 20:09:06.184021 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-55034e55-40a3-4295-b609-3542d3e526d3 req-78be5f65-5f34-42f6-ab0d-165c8e41744b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112675 Apr 15 20:09:06.184740 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 627/1323] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:09:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:09:06.434806 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-499b8d1b-06d5-4e87-a44d-ce727ec06b8e tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:09:06.435642 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-499b8d1b-06d5-4e87-a44d-ce727ec06b8e tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 17b722fa-9e4a-48dd-88f8-93d1f656e655] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:09:06.443624 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-499b8d1b-06d5-4e87-a44d-ce727ec06b8e tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:09:06.444138 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-499b8d1b-06d5-4e87-a44d-ce727ec06b8e tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:09:06.444991 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-499b8d1b-06d5-4e87-a44d-ce727ec06b8e tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:09:06.445485 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-499b8d1b-06d5-4e87-a44d-ce727ec06b8e tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:09:06.669664 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-499b8d1b-06d5-4e87-a44d-ce727ec06b8e tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:09:06.681872 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-499b8d1b-06d5-4e87-a44d-ce727ec06b8e tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655" status: 200 len: 1265 microversion: 2.1 time: 0.251555 Apr 15 20:09:06.682716 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 697/1324] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:09:06 2021] GET /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655 => generated 1265 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:09:07.702466 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-de923a0e-4600-4d83-a07e-dabf0f671ca4 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:09:07.703813 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-de923a0e-4600-4d83-a07e-dabf0f671ca4 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 17b722fa-9e4a-48dd-88f8-93d1f656e655] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:09:07.715628 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-de923a0e-4600-4d83-a07e-dabf0f671ca4 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:09:07.716279 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-de923a0e-4600-4d83-a07e-dabf0f671ca4 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:09:07.717334 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-de923a0e-4600-4d83-a07e-dabf0f671ca4 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:09:07.717957 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-de923a0e-4600-4d83-a07e-dabf0f671ca4 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:09:07.938562 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-de923a0e-4600-4d83-a07e-dabf0f671ca4 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:09:07.947535 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-de923a0e-4600-4d83-a07e-dabf0f671ca4 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655" status: 200 len: 1265 microversion: 2.1 time: 0.250833 Apr 15 20:09:07.948164 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 628/1325] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:09:07 2021] GET /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655 => generated 1265 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:09:08.966317 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-420ff247-4af7-4986-901e-1c0e0d02f59c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:09:08.966916 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-420ff247-4af7-4986-901e-1c0e0d02f59c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 17b722fa-9e4a-48dd-88f8-93d1f656e655] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:09:08.974797 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-420ff247-4af7-4986-901e-1c0e0d02f59c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:09:08.975333 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-420ff247-4af7-4986-901e-1c0e0d02f59c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:09:08.976180 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-420ff247-4af7-4986-901e-1c0e0d02f59c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:09:08.976673 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-420ff247-4af7-4986-901e-1c0e0d02f59c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:09:09.194250 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-420ff247-4af7-4986-901e-1c0e0d02f59c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:09:09.203723 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-420ff247-4af7-4986-901e-1c0e0d02f59c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655" status: 200 len: 1452 microversion: 2.1 time: 0.242060 Apr 15 20:09:09.204346 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 698/1326] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:09:08 2021] GET /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655 => generated 1452 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:09:09.221144 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-6e29e365-8302-474f-ad28-684989ecfa81 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:09:09.221801 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-6e29e365-8302-474f-ad28-684989ecfa81 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 17b722fa-9e4a-48dd-88f8-93d1f656e655] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:09:09.229735 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6e29e365-8302-474f-ad28-684989ecfa81 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:09:09.230319 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6e29e365-8302-474f-ad28-684989ecfa81 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:09:09.231211 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6e29e365-8302-474f-ad28-684989ecfa81 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:09:09.231828 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-6e29e365-8302-474f-ad28-684989ecfa81 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:09:09.446559 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-6e29e365-8302-474f-ad28-684989ecfa81 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:09:09.456180 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-6e29e365-8302-474f-ad28-684989ecfa81 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655" status: 200 len: 1452 microversion: 2.1 time: 0.239269 Apr 15 20:09:09.456804 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 629/1327] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:09:09 2021] GET /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655 => generated 1452 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:09:12.551826 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-1654f196-bb58-40e0-bdd8-e557b3211547 req-a03ff2c8-cf5f-4fb9-a162-61d84212e2c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17b722fa-9e4a-48dd-88f8-93d1f656e655", "tag": "5358e72c-15a2-43ec-b22a-4dd2c6f3c647"}]} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:09:12.554069 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:09:12.554069 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:09:12.562910 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-1654f196-bb58-40e0-bdd8-e557b3211547 req-a03ff2c8-cf5f-4fb9-a162-61d84212e2c9 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:09:12.563904 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-1654f196-bb58-40e0-bdd8-e557b3211547 req-a03ff2c8-cf5f-4fb9-a162-61d84212e2c9 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:09:12.582293 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-1654f196-bb58-40e0-bdd8-e557b3211547 req-a03ff2c8-cf5f-4fb9-a162-61d84212e2c9 service nova] Creating event network-changed:5358e72c-15a2-43ec-b22a-4dd2c6f3c647 for instance 17b722fa-9e4a-48dd-88f8-93d1f656e655 on hv-cinder-78638 Apr 15 20:09:12.587739 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-1654f196-bb58-40e0-bdd8-e557b3211547 req-a03ff2c8-cf5f-4fb9-a162-61d84212e2c9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105471 Apr 15 20:09:12.588611 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 699/1328] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:09:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:10:32.082805 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 15 20:10:32.083400 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: Thu Apr 15 20:10:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 15 20:11:00.243832 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-2f197cae-8ad6-4539-9461-6f2047922a5e tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:11:00.244408 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-2f197cae-8ad6-4539-9461-6f2047922a5e tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 17b722fa-9e4a-48dd-88f8-93d1f656e655] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:11:00.253222 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-3563716e-27db-47c9-a550-2564e37d7ddb req-ab54afad-cbea-4ccf-acbe-31a4b79c311d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17b722fa-9e4a-48dd-88f8-93d1f656e655", "tag": "5358e72c-15a2-43ec-b22a-4dd2c6f3c647"}]} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:11:00.254886 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:11:00.254886 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:11:00.265795 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2f197cae-8ad6-4539-9461-6f2047922a5e tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:11:00.266162 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-3563716e-27db-47c9-a550-2564e37d7ddb req-ab54afad-cbea-4ccf-acbe-31a4b79c311d service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:11:00.266654 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-3563716e-27db-47c9-a550-2564e37d7ddb req-ab54afad-cbea-4ccf-acbe-31a4b79c311d service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:11:00.266847 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2f197cae-8ad6-4539-9461-6f2047922a5e tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:11:00.267952 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2f197cae-8ad6-4539-9461-6f2047922a5e tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:11:00.268699 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-2f197cae-8ad6-4539-9461-6f2047922a5e tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:11:00.285952 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-3563716e-27db-47c9-a550-2564e37d7ddb req-ab54afad-cbea-4ccf-acbe-31a4b79c311d service nova] Creating event network-changed:5358e72c-15a2-43ec-b22a-4dd2c6f3c647 for instance 17b722fa-9e4a-48dd-88f8-93d1f656e655 on hv-cinder-78638 Apr 15 20:11:00.291395 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-3563716e-27db-47c9-a550-2564e37d7ddb req-ab54afad-cbea-4ccf-acbe-31a4b79c311d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042500 Apr 15 20:11:00.292344 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 700/1329] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:11:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:11:00.352900 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-2f197cae-8ad6-4539-9461-6f2047922a5e tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 17b722fa-9e4a-48dd-88f8-93d1f656e655] Going to try to terminate instance {{(pid=99512) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 15 20:11:00.478288 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-2f197cae-8ad6-4539-9461-6f2047922a5e tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "DELETE /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655" status: 204 len: 0 microversion: 2.1 time: 0.239159 Apr 15 20:11:00.478916 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 630/1330] 10.222.0.58 () {58 vars in 1229 bytes} [Thu Apr 15 20:11:00 2021] DELETE /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 15 20:11:00.489123 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e4d59e67-12a8-459b-8bc3-131851441841 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:11:00.489841 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e4d59e67-12a8-459b-8bc3-131851441841 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 17b722fa-9e4a-48dd-88f8-93d1f656e655] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:11:00.498797 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e4d59e67-12a8-459b-8bc3-131851441841 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:11:00.499382 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e4d59e67-12a8-459b-8bc3-131851441841 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:11:00.500240 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e4d59e67-12a8-459b-8bc3-131851441841 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:11:00.500745 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e4d59e67-12a8-459b-8bc3-131851441841 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:11:01.032412 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-e4d59e67-12a8-459b-8bc3-131851441841 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:11:01.044818 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e4d59e67-12a8-459b-8bc3-131851441841 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655" status: 200 len: 1576 microversion: 2.1 time: 0.560297 Apr 15 20:11:01.055637 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 701/1331] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:11:00 2021] GET /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655 => generated 1576 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:11:02.065235 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-e04ebbac-97f8-4eb7-8031-99c90648b72f tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:11:02.066049 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-e04ebbac-97f8-4eb7-8031-99c90648b72f tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 17b722fa-9e4a-48dd-88f8-93d1f656e655] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:11:02.073990 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e04ebbac-97f8-4eb7-8031-99c90648b72f tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:11:02.074493 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e04ebbac-97f8-4eb7-8031-99c90648b72f tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:11:02.075335 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e04ebbac-97f8-4eb7-8031-99c90648b72f tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:11:02.075831 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-e04ebbac-97f8-4eb7-8031-99c90648b72f tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:11:02.347030 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-e04ebbac-97f8-4eb7-8031-99c90648b72f tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:11:02.356079 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-e04ebbac-97f8-4eb7-8031-99c90648b72f tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655" status: 200 len: 1458 microversion: 2.1 time: 0.295294 Apr 15 20:11:02.356706 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 631/1332] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:11:02 2021] GET /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655 => generated 1458 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:11:03.286695 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-8869e264-332c-4056-9f29-9bace301f4e5 req-e6241e33-911e-4e79-aada-f2071c34400c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17b722fa-9e4a-48dd-88f8-93d1f656e655", "name": "network-vif-deleted", "tag": "5358e72c-15a2-43ec-b22a-4dd2c6f3c647"}]} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:11:03.288647 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:11:03.288647 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:11:03.298929 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-8869e264-332c-4056-9f29-9bace301f4e5 req-e6241e33-911e-4e79-aada-f2071c34400c service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:11:03.299456 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-8869e264-332c-4056-9f29-9bace301f4e5 req-e6241e33-911e-4e79-aada-f2071c34400c service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:11:03.320947 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-8869e264-332c-4056-9f29-9bace301f4e5 req-e6241e33-911e-4e79-aada-f2071c34400c service nova] Creating event network-vif-deleted:5358e72c-15a2-43ec-b22a-4dd2c6f3c647 for instance 17b722fa-9e4a-48dd-88f8-93d1f656e655 on hv-cinder-78638 Apr 15 20:11:03.326709 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-8869e264-332c-4056-9f29-9bace301f4e5 req-e6241e33-911e-4e79-aada-f2071c34400c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044015 Apr 15 20:11:03.327921 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 702/1333] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:11:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:11:03.374992 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a6280975-c184-4fbb-b563-b2919c354847 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:11:03.375684 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a6280975-c184-4fbb-b563-b2919c354847 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 17b722fa-9e4a-48dd-88f8-93d1f656e655] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:11:03.383478 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a6280975-c184-4fbb-b563-b2919c354847 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:11:03.383985 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a6280975-c184-4fbb-b563-b2919c354847 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:11:03.384810 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a6280975-c184-4fbb-b563-b2919c354847 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:11:03.385294 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a6280975-c184-4fbb-b563-b2919c354847 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:11:03.526886 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a6280975-c184-4fbb-b563-b2919c354847 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:11:03.536053 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a6280975-c184-4fbb-b563-b2919c354847 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655" status: 200 len: 1225 microversion: 2.1 time: 0.165850 Apr 15 20:11:03.536681 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 632/1334] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:11:03 2021] GET /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655 => generated 1225 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:11:04.555060 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-45c65cc3-88d2-41e8-9bbc-ebeb8b538eab tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:11:04.555866 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-45c65cc3-88d2-41e8-9bbc-ebeb8b538eab tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 17b722fa-9e4a-48dd-88f8-93d1f656e655] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:11:04.564561 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-45c65cc3-88d2-41e8-9bbc-ebeb8b538eab tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:11:04.565075 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-45c65cc3-88d2-41e8-9bbc-ebeb8b538eab tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:11:04.565920 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-45c65cc3-88d2-41e8-9bbc-ebeb8b538eab tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:11:04.566415 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-45c65cc3-88d2-41e8-9bbc-ebeb8b538eab tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:11:04.618647 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-45c65cc3-88d2-41e8-9bbc-ebeb8b538eab tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] HTTP exception thrown: Instance 17b722fa-9e4a-48dd-88f8-93d1f656e655 could not be found. Apr 15 20:11:04.619345 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-45c65cc3-88d2-41e8-9bbc-ebeb8b538eab tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Returning 404 to user: Instance 17b722fa-9e4a-48dd-88f8-93d1f656e655 could not be found. {{(pid=99511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 20:11:04.620263 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-45c65cc3-88d2-41e8-9bbc-ebeb8b538eab tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655" status: 404 len: 111 microversion: 2.1 time: 0.069820 Apr 15 20:11:04.621101 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 703/1335] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:11:04 2021] GET /compute/v2.1/servers/17b722fa-9e4a-48dd-88f8-93d1f656e655 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 15 20:11:08.881508 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-92966245-1ef4-41c1-98b2-578c8e7621f3 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:11:08.882116 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-92966245-1ef4-41c1-98b2-578c8e7621f3 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 6f9e6ef9-1db2-4595-8248-ad9b8e016a14] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:11:08.884281 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-cd9eab05-e73a-4164-bdfa-b86632156321 req-b2e698ef-f3b2-4af5-860d-ee88f6f8c7cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f9e6ef9-1db2-4595-8248-ad9b8e016a14", "tag": "b64308a7-eb62-4b2e-9892-8ef7175a60d5"}]} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:11:08.886309 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:11:08.886309 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:11:08.891304 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-92966245-1ef4-41c1-98b2-578c8e7621f3 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:11:08.891737 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-92966245-1ef4-41c1-98b2-578c8e7621f3 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:11:08.892598 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-92966245-1ef4-41c1-98b2-578c8e7621f3 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:11:08.893098 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-92966245-1ef4-41c1-98b2-578c8e7621f3 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:11:08.895880 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-cd9eab05-e73a-4164-bdfa-b86632156321 req-b2e698ef-f3b2-4af5-860d-ee88f6f8c7cc service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:11:08.896388 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-cd9eab05-e73a-4164-bdfa-b86632156321 req-b2e698ef-f3b2-4af5-860d-ee88f6f8c7cc service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:11:08.914774 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-cd9eab05-e73a-4164-bdfa-b86632156321 req-b2e698ef-f3b2-4af5-860d-ee88f6f8c7cc service nova] Creating event network-changed:b64308a7-eb62-4b2e-9892-8ef7175a60d5 for instance 6f9e6ef9-1db2-4595-8248-ad9b8e016a14 on hv-cinder-78638 Apr 15 20:11:08.920228 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-cd9eab05-e73a-4164-bdfa-b86632156321 req-b2e698ef-f3b2-4af5-860d-ee88f6f8c7cc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039784 Apr 15 20:11:08.920989 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 704/1336] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:11:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 15 20:11:08.959771 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-92966245-1ef4-41c1-98b2-578c8e7621f3 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 6f9e6ef9-1db2-4595-8248-ad9b8e016a14] Going to try to terminate instance {{(pid=99512) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 15 20:11:09.083648 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-92966245-1ef4-41c1-98b2-578c8e7621f3 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6f9e6ef9-1db2-4595-8248-ad9b8e016a14" status: 204 len: 0 microversion: 2.1 time: 0.206070 Apr 15 20:11:09.084483 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 633/1337] 10.222.0.58 () {58 vars in 1229 bytes} [Thu Apr 15 20:11:08 2021] DELETE /compute/v2.1/servers/6f9e6ef9-1db2-4595-8248-ad9b8e016a14 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 15 20:11:09.093693 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-f29c149d-bd9a-4d94-b960-6e5161aaab54 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:11:09.094691 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-f29c149d-bd9a-4d94-b960-6e5161aaab54 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 6f9e6ef9-1db2-4595-8248-ad9b8e016a14] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:11:09.103140 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f29c149d-bd9a-4d94-b960-6e5161aaab54 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:11:09.104161 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f29c149d-bd9a-4d94-b960-6e5161aaab54 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:11:09.104715 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f29c149d-bd9a-4d94-b960-6e5161aaab54 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:11:09.105218 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-f29c149d-bd9a-4d94-b960-6e5161aaab54 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:11:09.626604 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-f29c149d-bd9a-4d94-b960-6e5161aaab54 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99511) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:11:09.637772 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-f29c149d-bd9a-4d94-b960-6e5161aaab54 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/6f9e6ef9-1db2-4595-8248-ad9b8e016a14" status: 200 len: 1576 microversion: 2.1 time: 0.548636 Apr 15 20:11:09.638708 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 705/1338] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:11:09 2021] GET /compute/v2.1/servers/6f9e6ef9-1db2-4595-8248-ad9b8e016a14 => generated 1576 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:11:10.657793 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-a11ba5f9-d93f-4508-8b5a-900afdd3b5e2 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:11:10.658561 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-a11ba5f9-d93f-4508-8b5a-900afdd3b5e2 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 6f9e6ef9-1db2-4595-8248-ad9b8e016a14] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:11:10.666422 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a11ba5f9-d93f-4508-8b5a-900afdd3b5e2 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:11:10.666924 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a11ba5f9-d93f-4508-8b5a-900afdd3b5e2 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:11:10.667779 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a11ba5f9-d93f-4508-8b5a-900afdd3b5e2 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:11:10.668279 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-a11ba5f9-d93f-4508-8b5a-900afdd3b5e2 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:11:11.044356 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-a11ba5f9-d93f-4508-8b5a-900afdd3b5e2 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:11:11.053863 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-a11ba5f9-d93f-4508-8b5a-900afdd3b5e2 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/6f9e6ef9-1db2-4595-8248-ad9b8e016a14" status: 200 len: 1458 microversion: 2.1 time: 0.400955 Apr 15 20:11:11.054483 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 634/1339] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:11:10 2021] GET /compute/v2.1/servers/6f9e6ef9-1db2-4595-8248-ad9b8e016a14 => generated 1458 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:11:11.765394 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [req-53e5cce2-93ec-40fe-aac9-13ab9e8f6009 req-4ce5c5e7-893f-4bf4-abd0-0c808d8084a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f9e6ef9-1db2-4595-8248-ad9b8e016a14", "name": "network-vif-deleted", "tag": "b64308a7-eb62-4b2e-9892-8ef7175a60d5"}]} {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 15 20:11:11.767565 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 15 20:11:11.767565 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: warnings.warn(msg) Apr 15 20:11:11.777488 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-53e5cce2-93ec-40fe-aac9-13ab9e8f6009 req-4ce5c5e7-893f-4bf4-abd0-0c808d8084a4 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:11:11.777988 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [req-53e5cce2-93ec-40fe-aac9-13ab9e8f6009 req-4ce5c5e7-893f-4bf4-abd0-0c808d8084a4 service nova] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:11:11.798525 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.compute.server_external_events [req-53e5cce2-93ec-40fe-aac9-13ab9e8f6009 req-4ce5c5e7-893f-4bf4-abd0-0c808d8084a4 service nova] Creating event network-vif-deleted:b64308a7-eb62-4b2e-9892-8ef7175a60d5 for instance 6f9e6ef9-1db2-4595-8248-ad9b8e016a14 on hv-cinder-78638 Apr 15 20:11:11.804497 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [req-53e5cce2-93ec-40fe-aac9-13ab9e8f6009 req-4ce5c5e7-893f-4bf4-abd0-0c808d8084a4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043630 Apr 15 20:11:11.805140 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 706/1340] 10.222.0.58 () {64 vars in 1308 bytes} [Thu Apr 15 20:11:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 15 20:11:12.072821 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-b530bb5c-501c-46bf-adaf-ba90b99113ba tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:11:12.073497 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-b530bb5c-501c-46bf-adaf-ba90b99113ba tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 6f9e6ef9-1db2-4595-8248-ad9b8e016a14] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:11:12.082879 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b530bb5c-501c-46bf-adaf-ba90b99113ba tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:11:12.083408 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b530bb5c-501c-46bf-adaf-ba90b99113ba tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:11:12.084375 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b530bb5c-501c-46bf-adaf-ba90b99113ba tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:11:12.085031 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-b530bb5c-501c-46bf-adaf-ba90b99113ba tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:11:12.229175 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.policy [None req-b530bb5c-501c-46bf-adaf-ba90b99113ba tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9d86e8f847470c8403807462b1f8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2a79620ac740e5a6e598a862a97631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99512) authorize /opt/stack/nova/nova/policy.py:202}} Apr 15 20:11:12.238077 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-b530bb5c-501c-46bf-adaf-ba90b99113ba tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/6f9e6ef9-1db2-4595-8248-ad9b8e016a14" status: 200 len: 1224 microversion: 2.1 time: 0.169278 Apr 15 20:11:12.238687 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 635/1341] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:11:12 2021] GET /compute/v2.1/servers/6f9e6ef9-1db2-4595-8248-ad9b8e016a14 => generated 1224 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 15 20:11:13.257042 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d324764d-2e49-43b6-ac35-8588c1ecc5a2 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:11:13.257808 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-d324764d-2e49-43b6-ac35-8588c1ecc5a2 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: 6f9e6ef9-1db2-4595-8248-ad9b8e016a14] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:11:13.265903 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d324764d-2e49-43b6-ac35-8588c1ecc5a2 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:11:13.266403 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d324764d-2e49-43b6-ac35-8588c1ecc5a2 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:11:13.267232 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d324764d-2e49-43b6-ac35-8588c1ecc5a2 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:11:13.267744 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-d324764d-2e49-43b6-ac35-8588c1ecc5a2 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:11:13.320170 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-d324764d-2e49-43b6-ac35-8588c1ecc5a2 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] HTTP exception thrown: Instance 6f9e6ef9-1db2-4595-8248-ad9b8e016a14 could not be found. Apr 15 20:11:13.320812 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-d324764d-2e49-43b6-ac35-8588c1ecc5a2 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Returning 404 to user: Instance 6f9e6ef9-1db2-4595-8248-ad9b8e016a14 could not be found. {{(pid=99511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 20:11:13.321676 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-d324764d-2e49-43b6-ac35-8588c1ecc5a2 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/6f9e6ef9-1db2-4595-8248-ad9b8e016a14" status: 404 len: 111 microversion: 2.1 time: 0.069216 Apr 15 20:11:13.322264 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 707/1342] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:11:13 2021] GET /compute/v2.1/servers/6f9e6ef9-1db2-4595-8248-ad9b8e016a14 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 15 20:11:14.469909 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-1c1877f0-23a3-41fa-9fe9-fb27c7a8e458 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:11:14.470464 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-1c1877f0-23a3-41fa-9fe9-fb27c7a8e458 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: ee7a266a-70f6-4c26-b5e4-3c7c99a196b1] Fetching instance by UUID {{(pid=99512) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:11:14.478246 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1c1877f0-23a3-41fa-9fe9-fb27c7a8e458 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:11:14.478750 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1c1877f0-23a3-41fa-9fe9-fb27c7a8e458 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:11:14.479617 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1c1877f0-23a3-41fa-9fe9-fb27c7a8e458 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:11:14.480112 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-1c1877f0-23a3-41fa-9fe9-fb27c7a8e458 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99512) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:11:14.535763 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-1c1877f0-23a3-41fa-9fe9-fb27c7a8e458 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] HTTP exception thrown: Instance ee7a266a-70f6-4c26-b5e4-3c7c99a196b1 could not be found. Apr 15 20:11:14.536403 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-1c1877f0-23a3-41fa-9fe9-fb27c7a8e458 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Returning 404 to user: Instance ee7a266a-70f6-4c26-b5e4-3c7c99a196b1 could not be found. {{(pid=99512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 20:11:14.537303 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-1c1877f0-23a3-41fa-9fe9-fb27c7a8e458 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1" status: 404 len: 111 microversion: 2.1 time: 0.071508 Apr 15 20:11:14.537910 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 636/1343] 10.222.0.58 () {58 vars in 1229 bytes} [Thu Apr 15 20:11:14 2021] DELETE /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 15 20:11:14.546558 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-204b8646-7036-454b-a141-73089f16475c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '>' {{(pid=99511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:11:14.547231 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.compute.api [None req-204b8646-7036-454b-a141-73089f16475c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] [instance: ee7a266a-70f6-4c26-b5e4-3c7c99a196b1] Fetching instance by UUID {{(pid=99511) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 15 20:11:14.555047 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-204b8646-7036-454b-a141-73089f16475c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:11:14.555589 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-204b8646-7036-454b-a141-73089f16475c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:11:14.556423 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-204b8646-7036-454b-a141-73089f16475c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 15 20:11:14.556913 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG oslo_concurrency.lockutils [None req-204b8646-7036-454b-a141-73089f16475c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Lock "8e59ab27-c8e0-4643-bc4c-06d479de8174" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99511) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 15 20:11:14.610160 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.wsgi [None req-204b8646-7036-454b-a141-73089f16475c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] HTTP exception thrown: Instance ee7a266a-70f6-4c26-b5e4-3c7c99a196b1 could not be found. Apr 15 20:11:14.610815 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-204b8646-7036-454b-a141-73089f16475c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Returning 404 to user: Instance ee7a266a-70f6-4c26-b5e4-3c7c99a196b1 could not be found. {{(pid=99511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 15 20:11:14.611726 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-204b8646-7036-454b-a141-73089f16475c tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1" status: 404 len: 111 microversion: 2.1 time: 0.069218 Apr 15 20:11:14.612326 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99511|app: 0|req: 708/1344] 10.222.0.58 () {58 vars in 1226 bytes} [Thu Apr 15 20:11:14 2021] GET /compute/v2.1/servers/ee7a266a-70f6-4c26-b5e4-3c7c99a196b1 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 15 20:11:16.059439 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: DEBUG nova.api.openstack.wsgi [None req-9814eda4-a977-4ea8-9548-d39b3c419e24 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] Calling method '.version_select at 0x7f18d37871e0>' {{(pid=99512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 15 20:11:16.079475 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO nova.api.openstack.requestlog [None req-9814eda4-a977-4ea8-9548-d39b3c419e24 tempest-TestVolumeBootPattern-1607025748 tempest-TestVolumeBootPattern-1607025748-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-934650097" status: 202 len: 0 microversion: 2.1 time: 0.024003 Apr 15 20:11:16.080267 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: [pid: 99512|app: 0|req: 637/1345] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Apr 15 20:11:16 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-934650097 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 15 20:11:46.371656 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 15 20:11:46.372267 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: Thu Apr 15 20:11:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 15 20:12:20.938135 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 15 20:12:20.938721 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: Thu Apr 15 20:12:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 15 20:13:44.089936 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 15 20:13:44.090593 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: Thu Apr 15 20:13:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 15 20:13:52.099231 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 15 20:13:52.099826 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: Thu Apr 15 20:13:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 15 20:13:57.375316 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 15 20:13:57.375899 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: Thu Apr 15 20:13:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 15 20:15:06.388180 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 15 20:15:06.388797 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: Thu Apr 15 20:15:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 15 20:15:40.954967 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 15 20:15:40.955643 dv-cinder-786384-2-iscsi devstack@n-api.service[99509]: Thu Apr 15 20:15:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!